Max level shown:
12025-01-11T05:30:00.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
22025-01-11T05:30:00.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32025-01-11T05:30:00.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
42025-01-11T05:30:00.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52025-01-11T05:30:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62025-01-11T05:30:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72025-01-11T05:30:00.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82025-01-11T05:30:00.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92025-01-11T05:30:00.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102025-01-11T05:30:00.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112025-01-11T05:30:00.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122025-01-11T05:30:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132025-01-11T05:30:00.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142025-01-11T05:30:00.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152025-01-11T05:30:00.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
162025-01-11T05:30:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
172025-01-11T05:30:00.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182025-01-11T05:30:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192025-01-11T05:30:00.660ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
202025-01-11T05:30:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.5483ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
212025-01-11T05:30:00.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.18044ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
222025-01-11T05:30:01.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b85c1c0d-0f9c-418e-9433-3be2f096d672 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
232025-01-11T05:30:01.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b85c1c0d-0f9c-418e-9433-3be2f096d672 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
242025-01-11T05:30:01.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b85c1c0d-0f9c-418e-9433-3be2f096d672 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
252025-01-11T05:30:02.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4c712fde-d605-45ba-b844-f6022282629f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
262025-01-11T05:30:02.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4c712fde-d605-45ba-b844-f6022282629f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
272025-01-11T05:30:02.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4c712fde-d605-45ba-b844-f6022282629f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
282025-01-11T05:30:03.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 97e32694-ce87-44a3-8fe4-33aa58a82e8c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
292025-01-11T05:30:03.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 97e32694-ce87-44a3-8fe4-33aa58a82e8c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
302025-01-11T05:30:03.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 97e32694-ce87-44a3-8fe4-33aa58a82e8c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
312025-01-11T05:30:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 1f063385-7c55-4aca-aaac-8c45beec13cc response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
322025-01-11T05:30:04.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5e005862-bf7f-4c80-acd7-e57e3b7d9a6e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
332025-01-11T05:30:04.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5e005862-bf7f-4c80-acd7-e57e3b7d9a6e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
342025-01-11T05:30:04.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5e005862-bf7f-4c80-acd7-e57e3b7d9a6e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
352025-01-11T05:30:05.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 356fa168-e365-4dfc-a70d-d0e9cc211d1c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
362025-01-11T05:30:05.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 356fa168-e365-4dfc-a70d-d0e9cc211d1c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
372025-01-11T05:30:05.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 356fa168-e365-4dfc-a70d-d0e9cc211d1c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
382025-01-11T05:30:06.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 48084ac5-813b-45d4-a4d6-a19c42575766 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
392025-01-11T05:30:06.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 48084ac5-813b-45d4-a4d6-a19c42575766 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
402025-01-11T05:30:06.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 48084ac5-813b-45d4-a4d6-a19c42575766 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
412025-01-11T05:30:07.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5c11861a-0656-445a-a94e-ddfa0b864388 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
422025-01-11T05:30:07.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5c11861a-0656-445a-a94e-ddfa0b864388 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
432025-01-11T05:30:07.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5c11861a-0656-445a-a94e-ddfa0b864388 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
442025-01-11T05:30:08.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c96116be-3e26-4021-8f3a-6a1f143502e4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
452025-01-11T05:30:08.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c96116be-3e26-4021-8f3a-6a1f143502e4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
462025-01-11T05:30:08.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c96116be-3e26-4021-8f3a-6a1f143502e4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
472025-01-11T05:30:09.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e9ed5023-acd7-44d0-9cdc-61513c04ded4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
482025-01-11T05:30:09.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e9ed5023-acd7-44d0-9cdc-61513c04ded4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
492025-01-11T05:30:09.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e9ed5023-acd7-44d0-9cdc-61513c04ded4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
502025-01-11T05:30:10.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6dc87f00-df91-42d1-9c34-3d9582cd0a8e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
512025-01-11T05:30:10.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6dc87f00-df91-42d1-9c34-3d9582cd0a8e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
522025-01-11T05:30:10.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6dc87f00-df91-42d1-9c34-3d9582cd0a8e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
532025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
542025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
552025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
562025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
572025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
582025-01-11T05:30:10.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
592025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
602025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
612025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
622025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
632025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
642025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
652025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
662025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
672025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
682025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
692025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
702025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
712025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
722025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
732025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
742025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
752025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
762025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
772025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
782025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
792025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
802025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
812025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
822025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
832025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
842025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
852025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
862025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
882025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
892025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
902025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
912025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
922025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
932025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
942025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
952025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
962025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
972025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
982025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
992025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1002025-01-11T05:30:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1012025-01-11T05:30:10.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
1022025-01-11T05:30:10.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1032025-01-11T05:30:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1042025-01-11T05:30:10.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1052025-01-11T05:30:10.604ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.079095ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1062025-01-11T05:30:10.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1072025-01-11T05:30:10.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1082025-01-11T05:30:10.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1092025-01-11T05:30:10.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1350, tv_nsec: 161339127 } })
1102025-01-11T05:30:10.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1350, tv_nsec: 161554412 } })
1112025-01-11T05:30:10.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1122025-01-11T05:30:10.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1132025-01-11T05:30:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1142025-01-11T05:30:10.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1152025-01-11T05:30:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1162025-01-11T05:30:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1172025-01-11T05:30:10.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1182025-01-11T05:30:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1192025-01-11T05:30:10.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1202025-01-11T05:30:10.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1212025-01-11T05:30:10.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1222025-01-11T05:30:10.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1232025-01-11T05:30:10.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1242025-01-11T05:30:10.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1252025-01-11T05:30:10.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1262025-01-11T05:30:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1272025-01-11T05:30:10.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1282025-01-11T05:30:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1292025-01-11T05:30:10.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1302025-01-11T05:30:10.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1312025-01-11T05:30:10.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.492566ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1322025-01-11T05:30:10.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1332025-01-11T05:30:10.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1342025-01-11T05:30:10.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1352025-01-11T05:30:10.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1362025-01-11T05:30:10.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1372025-01-11T05:30:10.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1382025-01-11T05:30:10.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1392025-01-11T05:30:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1402025-01-11T05:30:10.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1412025-01-11T05:30:10.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1422025-01-11T05:30:10.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1432025-01-11T05:30:10.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1442025-01-11T05:30:10.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1452025-01-11T05:30:10.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1350, tv_nsec: 176613872 } })
1462025-01-11T05:30:10.621ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
1472025-01-11T05:30:10.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
1482025-01-11T05:30:10.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1492025-01-11T05:30:10.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1502025-01-11T05:30:10.637ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
1512025-01-11T05:30:10.637ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.568539ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
1522025-01-11T05:30:10.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.561554ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
1532025-01-11T05:30:10.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1542025-01-11T05:30:10.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1552025-01-11T05:30:10.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1562025-01-11T05:30:10.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1572025-01-11T05:30:10.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1582025-01-11T05:30:10.646ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1592025-01-11T05:30:10.646ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1602025-01-11T05:30:10.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1612025-01-11T05:30:10.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1622025-01-11T05:30:10.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1632025-01-11T05:30:10.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1642025-01-11T05:30:10.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1652025-01-11T05:30:10.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1662025-01-11T05:30:10.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
1672025-01-11T05:30:10.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1682025-01-11T05:30:10.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1692025-01-11T05:30:10.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1702025-01-11T05:30:10.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1712025-01-11T05:30:10.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.751858ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1722025-01-11T05:30:10.651ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.575345ms iteration = 14 status = 0
1732025-01-11T05:30:10.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.52434ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
1742025-01-11T05:30:10.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752025-01-11T05:30:10.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1762025-01-11T05:30:10.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1772025-01-11T05:30:10.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1782025-01-11T05:30:10.663ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1792025-01-11T05:30:10.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.991075ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1802025-01-11T05:30:10.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812025-01-11T05:30:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1822025-01-11T05:30:10.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1832025-01-11T05:30:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1842025-01-11T05:30:10.678ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1852025-01-11T05:30:10.678ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1862025-01-11T05:30:10.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1872025-01-11T05:30:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1882025-01-11T05:30:10.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.636639ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
1892025-01-11T05:30:10.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1902025-01-11T05:30:10.681ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1912025-01-11T05:30:10.682ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f25fc798-26d3-47ec-a430-cbd612f80f71", "content-length": "26", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
1922025-01-11T05:30:10.682ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1932025-01-11T05:30:10.684ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1942025-01-11T05:30:10.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.956494ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1952025-01-11T05:30:10.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1962025-01-11T05:30:10.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1972025-01-11T05:30:10.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1982025-01-11T05:30:10.739ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1992025-01-11T05:30:10.740ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5525dd25-0da6-46bc-97c9-3b4df43db965", "content-length": "26", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2002025-01-11T05:30:10.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2012025-01-11T05:30:10.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2022025-01-11T05:30:10.785ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2032025-01-11T05:30:10.785ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2042025-01-11T05:30:10.786ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "258a7ec4-0016-44ef-8819-67e687c94ca5", "content-length": "372", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2052025-01-11T05:30:10.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2062025-01-11T05:30:10.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2072025-01-11T05:30:10.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
2082025-01-11T05:30:10.798ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2092025-01-11T05:30:10.799ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54dd1dc2-81ba-4c57-94cc-61062631f02a", "content-length": "26", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2102025-01-11T05:30:10.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2112025-01-11T05:30:10.800ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.100487ms iteration = 14 status = {}
2122025-01-11T05:30:10.800ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
2132025-01-11T05:30:10.822ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2142025-01-11T05:30:10.822ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2152025-01-11T05:30:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 220.571388ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2162025-01-11T05:30:10.831ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2172025-01-11T05:30:10.831ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2278e52-7d05-4063-afbf-444d2e6a684b", "content-length": "1", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2182025-01-11T05:30:10.833ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2192025-01-11T05:30:10.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2202025-01-11T05:30:10.835ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.307228ms iteration = 14 status = null
2212025-01-11T05:30:10.838ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2222025-01-11T05:30:10.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2232025-01-11T05:30:10.838ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35b0b95a-e340-4a7f-b44c-35c9e16789d2", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2242025-01-11T05:30:10.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2252025-01-11T05:30:10.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2262025-01-11T05:30:10.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2272025-01-11T05:30:10.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2282025-01-11T05:30:10.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2292025-01-11T05:30:10.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2302025-01-11T05:30:10.848ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2312025-01-11T05:30:10.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2322025-01-11T05:30:10.849ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ee2640d2-0703-4fe7-a884-86a5e641705a", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2332025-01-11T05:30:10.851ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.98633ms iteration = 14 status = {}
2342025-01-11T05:30:10.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2352025-01-11T05:30:10.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2362025-01-11T05:30:10.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372025-01-11T05:30:10.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2382025-01-11T05:30:10.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2392025-01-11T05:30:10.889ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 286.997913ms iteration = 16 status = {"physical_disks_added":0}
2402025-01-11T05:30:10.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2412025-01-11T05:30:10.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422025-01-11T05:30:10.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2432025-01-11T05:30:10.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2442025-01-11T05:30:10.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2452025-01-11T05:30:10.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2462025-01-11T05:30:10.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472025-01-11T05:30:10.938ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
2482025-01-11T05:30:10.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2492025-01-11T05:30:10.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2502025-01-11T05:30:10.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2512025-01-11T05:30:10.946ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0073cd-9157-4b75-91c8-d4cb089a8d47", "content-length": "691", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2522025-01-11T05:30:10.946ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2532025-01-11T05:30:10.946ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2542025-01-11T05:30:10.946ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2552025-01-11T05:30:10.948ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 345.76693ms iteration = 14 status = {}
2562025-01-11T05:30:10.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2572025-01-11T05:30:10.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3cb347f-4880-4ae2-a547-667d9fa00318", "content-length": "134", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2582025-01-11T05:30:10.948ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2592025-01-11T05:30:10.948ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
2602025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2612025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2622025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2632025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2642025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2652025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2662025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2672025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2682025-01-11T05:30:10.949ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
2692025-01-11T05:30:10.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2702025-01-11T05:30:10.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2712025-01-11T05:30:10.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2722025-01-11T05:30:10.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "21ae5bde-e3cc-41ab-9bc0-c53e6ec0a1af", "content-length": "2", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2732025-01-11T05:30:10.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2742025-01-11T05:30:10.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3b37a2-0701-4f05-ba70-0c1a94e062f9", "content-length": "52", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2752025-01-11T05:30:10.952ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
2762025-01-11T05:30:10.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2772025-01-11T05:30:11.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9670c11e-2e36-459b-8127-7863b0f22022", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2782025-01-11T05:30:11.046ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
2792025-01-11T05:30:11.046ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2802025-01-11T05:30:11.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4762b4c-cbbe-4911-b39d-d27212cd2337", "content-length": "682", "date": "Sat, 11 Jan 2025 05:30:10 GMT"} })
2812025-01-11T05:30:11.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2822025-01-11T05:30:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2832025-01-11T05:30:11.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2842025-01-11T05:30:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2852025-01-11T05:30:11.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2862025-01-11T05:30:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2872025-01-11T05:30:11.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2882025-01-11T05:30:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2892025-01-11T05:30:11.063ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 461.522303ms iteration = 14 status = {}
2902025-01-11T05:30:11.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = eee7b777-3189-475c-bd0e-8a08de219326 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
2912025-01-11T05:30:11.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = eee7b777-3189-475c-bd0e-8a08de219326 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
2922025-01-11T05:30:11.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = eee7b777-3189-475c-bd0e-8a08de219326 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
2932025-01-11T05:30:11.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 306d50f6-e321-4e23-bea6-eab458ebf5a9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2942025-01-11T05:30:11.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 306d50f6-e321-4e23-bea6-eab458ebf5a9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2952025-01-11T05:30:11.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 306d50f6-e321-4e23-bea6-eab458ebf5a9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2962025-01-11T05:30:12.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3e6c5d8f-a918-4369-8275-c04fc5de8d88 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
2972025-01-11T05:30:12.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3e6c5d8f-a918-4369-8275-c04fc5de8d88 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
2982025-01-11T05:30:12.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3e6c5d8f-a918-4369-8275-c04fc5de8d88 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
2992025-01-11T05:30:13.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05c81fbe-2302-441b-b3d1-03c35f4a5537 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3002025-01-11T05:30:13.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05c81fbe-2302-441b-b3d1-03c35f4a5537 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3012025-01-11T05:30:13.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05c81fbe-2302-441b-b3d1-03c35f4a5537 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3022025-01-11T05:30:13.784ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 26d75210-354e-47ec-916e-2bebf4e80a0c response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
3032025-01-11T05:30:14.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 50c89d9f-68ab-44f2-a15f-95bb818f61d1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3042025-01-11T05:30:14.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 50c89d9f-68ab-44f2-a15f-95bb818f61d1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3052025-01-11T05:30:14.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 50c89d9f-68ab-44f2-a15f-95bb818f61d1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3062025-01-11T05:30:15.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 793b0ee3-3329-4ebc-a039-915f79a3403f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3072025-01-11T05:30:15.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 793b0ee3-3329-4ebc-a039-915f79a3403f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3082025-01-11T05:30:15.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 793b0ee3-3329-4ebc-a039-915f79a3403f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3092025-01-11T05:30:16.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8384648a-b1af-48a2-adb3-3992e3c2d66a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3102025-01-11T05:30:16.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8384648a-b1af-48a2-adb3-3992e3c2d66a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3112025-01-11T05:30:16.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8384648a-b1af-48a2-adb3-3992e3c2d66a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3122025-01-11T05:30:17.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d1713852-ab23-4a06-a218-a24cca9c739b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3132025-01-11T05:30:17.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d1713852-ab23-4a06-a218-a24cca9c739b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3142025-01-11T05:30:17.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d1713852-ab23-4a06-a218-a24cca9c739b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3152025-01-11T05:30:18.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 28e680fe-a291-4953-8564-ff2554642fdd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3162025-01-11T05:30:18.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 28e680fe-a291-4953-8564-ff2554642fdd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3172025-01-11T05:30:18.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 28e680fe-a291-4953-8564-ff2554642fdd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3182025-01-11T05:30:19.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a8b55886-4a2e-43ac-a40b-b642a66871dc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3192025-01-11T05:30:19.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a8b55886-4a2e-43ac-a40b-b642a66871dc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3202025-01-11T05:30:19.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a8b55886-4a2e-43ac-a40b-b642a66871dc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3212025-01-11T05:30:20.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
3222025-01-11T05:30:20.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3232025-01-11T05:30:20.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
3242025-01-11T05:30:20.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3252025-01-11T05:30:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3262025-01-11T05:30:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3272025-01-11T05:30:20.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3282025-01-11T05:30:20.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3292025-01-11T05:30:20.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3302025-01-11T05:30:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3312025-01-11T05:30:20.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3322025-01-11T05:30:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3332025-01-11T05:30:20.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3342025-01-11T05:30:20.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3352025-01-11T05:30:20.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3362025-01-11T05:30:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
3372025-01-11T05:30:20.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3382025-01-11T05:30:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3392025-01-11T05:30:20.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
3402025-01-11T05:30:20.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.479174ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
3412025-01-11T05:30:20.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.814608ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3422025-01-11T05:30:20.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bce8e48a-6d5a-4425-b9f3-e5bb3a1cd920 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3432025-01-11T05:30:20.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bce8e48a-6d5a-4425-b9f3-e5bb3a1cd920 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3442025-01-11T05:30:20.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bce8e48a-6d5a-4425-b9f3-e5bb3a1cd920 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3452025-01-11T05:30:21.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 195bce6b-6d95-4bb0-afd7-e60f4cb9dc2e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3462025-01-11T05:30:21.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 195bce6b-6d95-4bb0-afd7-e60f4cb9dc2e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3472025-01-11T05:30:21.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 195bce6b-6d95-4bb0-afd7-e60f4cb9dc2e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3482025-01-11T05:30:22.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52a1d22e-b6dd-4564-88b1-e765e3d5f453 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3492025-01-11T05:30:22.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52a1d22e-b6dd-4564-88b1-e765e3d5f453 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3502025-01-11T05:30:22.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52a1d22e-b6dd-4564-88b1-e765e3d5f453 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3512025-01-11T05:30:23.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 70ccde17-5348-4fab-81d7-500d2b93ddcb roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
3522025-01-11T05:30:23.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 70ccde17-5348-4fab-81d7-500d2b93ddcb resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
3532025-01-11T05:30:23.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 70ccde17-5348-4fab-81d7-500d2b93ddcb response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
3542025-01-11T05:30:23.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 92453a8b-213c-44bf-9c1d-705c1f3e02e8 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
3552025-01-11T05:30:23.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 92453a8b-213c-44bf-9c1d-705c1f3e02e8 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
3562025-01-11T05:30:23.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 92453a8b-213c-44bf-9c1d-705c1f3e02e8 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
3572025-01-11T05:30:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = c8337274-397e-4e1f-bc1f-7d5ae5da1302 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
3582025-01-11T05:30:23.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8c5c59c-655d-45d9-944a-054adaff3eca roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3592025-01-11T05:30:23.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8c5c59c-655d-45d9-944a-054adaff3eca resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3602025-01-11T05:30:23.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8c5c59c-655d-45d9-944a-054adaff3eca response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3612025-01-11T05:30:24.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 69413d8a-e703-4ab5-ac7b-0cc40d1cb0ec roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3622025-01-11T05:30:24.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 69413d8a-e703-4ab5-ac7b-0cc40d1cb0ec resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3632025-01-11T05:30:24.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 69413d8a-e703-4ab5-ac7b-0cc40d1cb0ec response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3642025-01-11T05:30:25.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = da27d9eb-b2f1-4c53-aaee-28a9d1e40c86 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3652025-01-11T05:30:25.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = da27d9eb-b2f1-4c53-aaee-28a9d1e40c86 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3662025-01-11T05:30:25.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = da27d9eb-b2f1-4c53-aaee-28a9d1e40c86 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3672025-01-11T05:30:26.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d243c7d4-c45c-4933-997e-de8bc41181ff roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3682025-01-11T05:30:26.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d243c7d4-c45c-4933-997e-de8bc41181ff resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3692025-01-11T05:30:26.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d243c7d4-c45c-4933-997e-de8bc41181ff response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3702025-01-11T05:30:27.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64e70316-366a-47d8-8506-dea97f3ddab4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3712025-01-11T05:30:27.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64e70316-366a-47d8-8506-dea97f3ddab4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3722025-01-11T05:30:27.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64e70316-366a-47d8-8506-dea97f3ddab4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3732025-01-11T05:30:28.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 70e49d88-05a7-4a7f-ba30-5988c2296277 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3742025-01-11T05:30:28.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 70e49d88-05a7-4a7f-ba30-5988c2296277 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3752025-01-11T05:30:28.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 70e49d88-05a7-4a7f-ba30-5988c2296277 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3762025-01-11T05:30:29.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0186897a-daf8-4d44-8665-f54de0b5bf42 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3772025-01-11T05:30:29.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0186897a-daf8-4d44-8665-f54de0b5bf42 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3782025-01-11T05:30:29.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0186897a-daf8-4d44-8665-f54de0b5bf42 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
3792025-01-11T05:30:30.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
3802025-01-11T05:30:30.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3812025-01-11T05:30:30.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
3822025-01-11T05:30:30.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3832025-01-11T05:30:30.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3842025-01-11T05:30:30.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3852025-01-11T05:30:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3862025-01-11T05:30:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3872025-01-11T05:30:30.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3882025-01-11T05:30:30.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.913434ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3892025-01-11T05:30:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3902025-01-11T05:30:30.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3912025-01-11T05:30:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3922025-01-11T05:30:30.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3932025-01-11T05:30:30.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3942025-01-11T05:30:30.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3952025-01-11T05:30:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
3962025-01-11T05:30:30.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3972025-01-11T05:30:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3982025-01-11T05:30:30.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
3992025-01-11T05:30:30.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.02356ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
4002025-01-11T05:30:30.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a347a3fd-3262-4709-9939-615020da237a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4012025-01-11T05:30:30.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a347a3fd-3262-4709-9939-615020da237a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4022025-01-11T05:30:30.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a347a3fd-3262-4709-9939-615020da237a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4032025-01-11T05:30:31.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4964707a-66e3-4248-9aca-ec63ad10abdf roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4042025-01-11T05:30:31.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4964707a-66e3-4248-9aca-ec63ad10abdf resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4052025-01-11T05:30:31.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4964707a-66e3-4248-9aca-ec63ad10abdf response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4062025-01-11T05:30:32.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d6627699-1dfa-4239-af63-c37c12d25a18 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4072025-01-11T05:30:32.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d6627699-1dfa-4239-af63-c37c12d25a18 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4082025-01-11T05:30:32.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d6627699-1dfa-4239-af63-c37c12d25a18 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4092025-01-11T05:30:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = cc6dd437-b2f7-4e8a-801c-9f9e742b3b4b response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
4102025-01-11T05:30:34.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b217450f-4c28-47df-afed-505febaba471 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4112025-01-11T05:30:34.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b217450f-4c28-47df-afed-505febaba471 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4122025-01-11T05:30:34.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b217450f-4c28-47df-afed-505febaba471 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4132025-01-11T05:30:35.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d0f34211-2421-423d-b454-031ce1f7b476 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4142025-01-11T05:30:35.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d0f34211-2421-423d-b454-031ce1f7b476 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4152025-01-11T05:30:35.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d0f34211-2421-423d-b454-031ce1f7b476 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4162025-01-11T05:30:36.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc0a1cbf-799b-476c-9a58-7577e67ef862 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4172025-01-11T05:30:36.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc0a1cbf-799b-476c-9a58-7577e67ef862 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4182025-01-11T05:30:36.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc0a1cbf-799b-476c-9a58-7577e67ef862 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4192025-01-11T05:30:37.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9c36aebf-1e86-4f98-a4a4-877279bd3e6e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4202025-01-11T05:30:37.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9c36aebf-1e86-4f98-a4a4-877279bd3e6e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4212025-01-11T05:30:37.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9c36aebf-1e86-4f98-a4a4-877279bd3e6e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4222025-01-11T05:30:38.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08912f8d-79b7-4dbb-9fff-5446a660d63f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4232025-01-11T05:30:38.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08912f8d-79b7-4dbb-9fff-5446a660d63f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4242025-01-11T05:30:38.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08912f8d-79b7-4dbb-9fff-5446a660d63f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4252025-01-11T05:30:39.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 235fda66-95ee-41ff-a6ea-44be85111418 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4262025-01-11T05:30:39.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 235fda66-95ee-41ff-a6ea-44be85111418 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4272025-01-11T05:30:39.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 235fda66-95ee-41ff-a6ea-44be85111418 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4282025-01-11T05:30:40.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9ce2e62f-b2e1-493e-8330-3946a6bbac90 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4292025-01-11T05:30:40.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9ce2e62f-b2e1-493e-8330-3946a6bbac90 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4302025-01-11T05:30:40.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9ce2e62f-b2e1-493e-8330-3946a6bbac90 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
4312025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
4322025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4332025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
4342025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
4352025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4362025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4372025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
4382025-01-11T05:30:40.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
4392025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.84\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
4402025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
4412025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
4422025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
4432025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4442025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4452025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4462025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
4472025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4482025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
4492025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4502025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4512025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4522025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
4532025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4542025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4552025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
4562025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
4572025-01-11T05:30:40.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:20:40.602299277 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4582025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4592025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
4602025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4612025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
4622025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
4632025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4642025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4652025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4662025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
4672025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4682025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4692025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
4702025-01-11T05:30:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4712025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4722025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
4732025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4742025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
4752025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4762025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4772025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
4782025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4792025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
4802025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
4812025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4822025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
4832025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4842025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
4852025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
4862025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4872025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4882025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
4892025-01-11T05:30:40.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4902025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4912025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4922025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4932025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4942025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4952025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4962025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4972025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4982025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4992025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5002025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5012025-01-11T05:30:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5022025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5032025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5042025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
5052025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5062025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5072025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5082025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5092025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5102025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5112025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5122025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5132025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5142025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5152025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5162025-01-11T05:30:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 158778777 } })
5172025-01-11T05:30:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 158795508 } })
5182025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5192025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5202025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.191116ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5212025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
5222025-01-11T05:30:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.329059ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5232025-01-11T05:30:40.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5242025-01-11T05:30:40.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5252025-01-11T05:30:40.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 160845213 } })
5262025-01-11T05:30:40.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5272025-01-11T05:30:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.132611ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5282025-01-11T05:30:40.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292025-01-11T05:30:40.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 163121833 } })
5302025-01-11T05:30:40.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5312025-01-11T05:30:40.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:20:40.602299277 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5322025-01-11T05:30:40.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.009342ms iteration = 8 status = {"expiration":"2025-01-11T05:20:40.602299277Z","pruned":[]}
5332025-01-11T05:30:40.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5342025-01-11T05:30:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5352025-01-11T05:30:40.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5362025-01-11T05:30:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5372025-01-11T05:30:40.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5382025-01-11T05:30:40.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5392025-01-11T05:30:40.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5402025-01-11T05:30:40.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5412025-01-11T05:30:40.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5422025-01-11T05:30:40.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5432025-01-11T05:30:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5442025-01-11T05:30:40.613ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.013911ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
5452025-01-11T05:30:40.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5462025-01-11T05:30:40.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5472025-01-11T05:30:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5482025-01-11T05:30:40.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5492025-01-11T05:30:40.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5502025-01-11T05:30:40.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5512025-01-11T05:30:40.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5522025-01-11T05:30:40.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5532025-01-11T05:30:40.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5542025-01-11T05:30:40.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5552025-01-11T05:30:40.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.566963ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
5562025-01-11T05:30:40.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5572025-01-11T05:30:40.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5582025-01-11T05:30:40.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5592025-01-11T05:30:40.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5602025-01-11T05:30:40.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5612025-01-11T05:30:40.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5622025-01-11T05:30:40.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5632025-01-11T05:30:40.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5642025-01-11T05:30:40.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652025-01-11T05:30:40.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662025-01-11T05:30:40.644ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5672025-01-11T05:30:40.644ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5682025-01-11T05:30:40.644ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 42.154273ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5692025-01-11T05:30:40.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5702025-01-11T05:30:40.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5712025-01-11T05:30:40.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5722025-01-11T05:30:40.647ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5732025-01-11T05:30:40.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5742025-01-11T05:30:40.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
5752025-01-11T05:30:40.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5762025-01-11T05:30:40.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5772025-01-11T05:30:40.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782025-01-11T05:30:40.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.680906ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5792025-01-11T05:30:40.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5802025-01-11T05:30:40.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5812025-01-11T05:30:40.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5822025-01-11T05:30:40.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5832025-01-11T05:30:40.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5842025-01-11T05:30:40.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5852025-01-11T05:30:40.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5862025-01-11T05:30:40.658ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5872025-01-11T05:30:40.658ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5882025-01-11T05:30:40.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5892025-01-11T05:30:40.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 55.821992ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
5902025-01-11T05:30:40.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5912025-01-11T05:30:40.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922025-01-11T05:30:40.659ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5932025-01-11T05:30:40.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.923526ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5942025-01-11T05:30:40.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5952025-01-11T05:30:40.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5962025-01-11T05:30:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5972025-01-11T05:30:40.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982025-01-11T05:30:40.662ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1380, tv_nsec: 218405213 } })
5992025-01-11T05:30:40.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6002025-01-11T05:30:40.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6012025-01-11T05:30:40.663ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
6022025-01-11T05:30:40.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.028173ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
6032025-01-11T05:30:40.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6042025-01-11T05:30:40.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052025-01-11T05:30:40.671ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062025-01-11T05:30:40.673ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
6072025-01-11T05:30:40.673ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.988254ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
6082025-01-11T05:30:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6092025-01-11T05:30:40.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6102025-01-11T05:30:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6112025-01-11T05:30:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6122025-01-11T05:30:40.674ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6132025-01-11T05:30:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6142025-01-11T05:30:40.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6152025-01-11T05:30:40.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6162025-01-11T05:30:40.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6172025-01-11T05:30:40.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6182025-01-11T05:30:40.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6192025-01-11T05:30:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6202025-01-11T05:30:40.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6212025-01-11T05:30:40.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222025-01-11T05:30:40.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.149173ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6232025-01-11T05:30:40.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6242025-01-11T05:30:40.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6252025-01-11T05:30:40.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6262025-01-11T05:30:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
6272025-01-11T05:30:40.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6282025-01-11T05:30:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6292025-01-11T05:30:40.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.5889ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6302025-01-11T05:30:40.701ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.432326ms iteration = 15 status = 0
6312025-01-11T05:30:40.704ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6322025-01-11T05:30:40.704ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6332025-01-11T05:30:40.704ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6342025-01-11T05:30:40.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6352025-01-11T05:30:40.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6362025-01-11T05:30:40.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6372025-01-11T05:30:40.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6382025-01-11T05:30:40.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6392025-01-11T05:30:40.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6402025-01-11T05:30:40.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6412025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6422025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6432025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6442025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6452025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6462025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6472025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6482025-01-11T05:30:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6492025-01-11T05:30:40.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502025-01-11T05:30:40.713ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6512025-01-11T05:30:40.713ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6522025-01-11T05:30:40.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6532025-01-11T05:30:40.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6542025-01-11T05:30:40.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6552025-01-11T05:30:40.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6562025-01-11T05:30:40.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6572025-01-11T05:30:40.721ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6582025-01-11T05:30:40.721ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6592025-01-11T05:30:40.721ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.021385ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6602025-01-11T05:30:40.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6612025-01-11T05:30:40.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6622025-01-11T05:30:40.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6632025-01-11T05:30:40.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6642025-01-11T05:30:40.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6652025-01-11T05:30:40.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6662025-01-11T05:30:40.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6672025-01-11T05:30:40.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6682025-01-11T05:30:40.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6692025-01-11T05:30:40.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.23622ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6702025-01-11T05:30:40.742ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6712025-01-11T05:30:40.742ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
6722025-01-11T05:30:40.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6732025-01-11T05:30:40.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6742025-01-11T05:30:40.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6752025-01-11T05:30:40.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6762025-01-11T05:30:40.744ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6772025-01-11T05:30:40.744ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6782025-01-11T05:30:40.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6792025-01-11T05:30:40.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6802025-01-11T05:30:40.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812025-01-11T05:30:40.747ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6822025-01-11T05:30:40.747ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6832025-01-11T05:30:40.748ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95198403-2af0-485f-b5f9-d95986a4222b", "content-length": "26", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
6842025-01-11T05:30:40.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6852025-01-11T05:30:40.748ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6862025-01-11T05:30:40.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872025-01-11T05:30:40.749ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6882025-01-11T05:30:40.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6892025-01-11T05:30:40.751ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6902025-01-11T05:30:40.751ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96079884-dacc-4671-8748-53a1891e9fde", "content-length": "26", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
6912025-01-11T05:30:40.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6922025-01-11T05:30:40.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6932025-01-11T05:30:40.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6942025-01-11T05:30:40.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6952025-01-11T05:30:40.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6962025-01-11T05:30:40.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6972025-01-11T05:30:40.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6982025-01-11T05:30:40.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6992025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7002025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7012025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
7022025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.459841ms iteration = 8 status = {"generation":1}
7032025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
7042025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7052025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
7062025-01-11T05:30:40.761ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 159.481761ms iteration = 8 status = {"generation":2}
7072025-01-11T05:30:40.779ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7082025-01-11T05:30:40.779ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 177.612948ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7092025-01-11T05:30:40.783ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.394881ms iteration = 17 status = {"physical_disks_added":0}
7102025-01-11T05:30:40.789ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
7112025-01-11T05:30:40.789ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.062045ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7122025-01-11T05:30:40.817ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
7132025-01-11T05:30:40.817ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7142025-01-11T05:30:40.817ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b202bf1-0c01-4487-be93-29593fef7ae5", "content-length": "26", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7152025-01-11T05:30:40.817ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7162025-01-11T05:30:40.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
7172025-01-11T05:30:40.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7182025-01-11T05:30:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7192025-01-11T05:30:40.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202025-01-11T05:30:40.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7212025-01-11T05:30:40.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7222025-01-11T05:30:40.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7232025-01-11T05:30:40.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242025-01-11T05:30:40.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7252025-01-11T05:30:40.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7262025-01-11T05:30:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7272025-01-11T05:30:40.901ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7282025-01-11T05:30:40.901ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7292025-01-11T05:30:40.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "94916284-4822-4881-a677-336b240b25a7", "content-length": "372", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7302025-01-11T05:30:40.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7312025-01-11T05:30:40.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7322025-01-11T05:30:40.914ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7332025-01-11T05:30:40.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7342025-01-11T05:30:40.930ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "29f4972e-4dbe-4cab-a59c-044a24b13202", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7352025-01-11T05:30:40.930ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7362025-01-11T05:30:40.931ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c6d9f8c3-2bb4-44da-b0f8-ef31a363f5fa", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7372025-01-11T05:30:40.931ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7382025-01-11T05:30:40.933ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7392025-01-11T05:30:40.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 330.710969ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7402025-01-11T05:30:40.945ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7412025-01-11T05:30:40.945ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7422025-01-11T05:30:40.946ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3bf4959a-737c-4053-970c-1692f33cfb85", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7432025-01-11T05:30:40.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7442025-01-11T05:30:40.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7452025-01-11T05:30:41.034ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7462025-01-11T05:30:41.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59f7c4f0-2117-4f72-8f7c-2758b5b2609e", "content-length": "691", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7472025-01-11T05:30:41.034ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7482025-01-11T05:30:41.034ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7492025-01-11T05:30:41.034ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7502025-01-11T05:30:41.035ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 433.343767ms iteration = 15 status = {}
7512025-01-11T05:30:41.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7522025-01-11T05:30:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7532025-01-11T05:30:41.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542025-01-11T05:30:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552025-01-11T05:30:41.041ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7562025-01-11T05:30:41.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7572025-01-11T05:30:41.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ded1caf0-b6f1-4577-93b2-aaee57688811", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7582025-01-11T05:30:41.043ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.433533ms iteration = 15 status = {}
7592025-01-11T05:30:41.045ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7602025-01-11T05:30:41.045ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e0affec-5264-41ab-bc0f-1f2892cdf360", "content-length": "1", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7612025-01-11T05:30:41.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7622025-01-11T05:30:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7632025-01-11T05:30:41.048ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 446.519554ms iteration = 15 status = null
7642025-01-11T05:30:41.048ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 446.781101ms iteration = 15 status = {}
7652025-01-11T05:30:41.059ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7662025-01-11T05:30:41.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "976dd446-f67c-4ebc-ad7d-5fb650dda1aa", "date": "Sat, 11 Jan 2025 05:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7672025-01-11T05:30:41.059ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7682025-01-11T05:30:41.061ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9cbf448e-4b80-42d6-b792-c754d0961858", "date": "Sat, 11 Jan 2025 05:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7692025-01-11T05:30:41.061ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7702025-01-11T05:30:41.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "981ee4e4-b9c9-4f4c-8f7c-9efb776978cc", "date": "Sat, 11 Jan 2025 05:30:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7712025-01-11T05:30:41.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7722025-01-11T05:30:41.063ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7732025-01-11T05:30:41.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 461.526803ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7742025-01-11T05:30:41.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7752025-01-11T05:30:41.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7762025-01-11T05:30:41.101ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
7772025-01-11T05:30:41.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7782025-01-11T05:30:41.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7792025-01-11T05:30:41.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7802025-01-11T05:30:41.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cf3838e-11c0-4f05-8361-5168827be3ec", "content-length": "134", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7812025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7822025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
7832025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7842025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7852025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7862025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7872025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7882025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7892025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7902025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7912025-01-11T05:30:41.111ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
7922025-01-11T05:30:41.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7932025-01-11T05:30:41.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7942025-01-11T05:30:41.114ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7952025-01-11T05:30:41.114ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2031a5be-9b3a-4ae6-aa54-19c07a91cf45", "content-length": "2", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7962025-01-11T05:30:41.114ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7972025-01-11T05:30:41.114ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "824b09ac-7bf0-4081-beca-102180a8b2f5", "content-length": "52", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
7982025-01-11T05:30:41.114ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
7992025-01-11T05:30:41.114ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8002025-01-11T05:30:41.212ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "092ad852-bd36-4cd7-a7c9-4867a16afc59", "date": "Sat, 11 Jan 2025 05:30:40 GMT"} })
8012025-01-11T05:30:41.212ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
8022025-01-11T05:30:41.212ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8032025-01-11T05:30:41.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b2979d30-0239-4305-a474-8c45849e577c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8042025-01-11T05:30:41.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b2979d30-0239-4305-a474-8c45849e577c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8052025-01-11T05:30:41.212ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f5b0a93-6462-4110-818e-8a8773817084", "content-length": "682", "date": "Sat, 11 Jan 2025 05:30:41 GMT"} })
8062025-01-11T05:30:41.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8072025-01-11T05:30:41.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8082025-01-11T05:30:41.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b2979d30-0239-4305-a474-8c45849e577c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8092025-01-11T05:30:41.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8102025-01-11T05:30:41.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8112025-01-11T05:30:41.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8122025-01-11T05:30:41.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8132025-01-11T05:30:41.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8142025-01-11T05:30:41.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8152025-01-11T05:30:41.230ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 628.351855ms iteration = 15 status = {}
8162025-01-11T05:30:41.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = f12252a2-8ff6-4e37-b9e1-f9d4a306dae3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8172025-01-11T05:30:41.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = f12252a2-8ff6-4e37-b9e1-f9d4a306dae3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8182025-01-11T05:30:41.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = f12252a2-8ff6-4e37-b9e1-f9d4a306dae3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8192025-01-11T05:30:42.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bebd755f-0339-4755-9997-cd1a6687375b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8202025-01-11T05:30:42.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bebd755f-0339-4755-9997-cd1a6687375b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8212025-01-11T05:30:42.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bebd755f-0339-4755-9997-cd1a6687375b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8222025-01-11T05:30:43.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5ca00590-6c98-4ef0-ab4b-35aa256f02fd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8232025-01-11T05:30:43.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5ca00590-6c98-4ef0-ab4b-35aa256f02fd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8242025-01-11T05:30:43.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5ca00590-6c98-4ef0-ab4b-35aa256f02fd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8252025-01-11T05:30:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 655 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 98e02ff7-8b7d-4c7a-9372-e5479caf4bb1 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
8262025-01-11T05:30:44.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7660fe92-c2dc-4589-b1dd-15554eaf1d3a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8272025-01-11T05:30:44.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7660fe92-c2dc-4589-b1dd-15554eaf1d3a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8282025-01-11T05:30:44.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7660fe92-c2dc-4589-b1dd-15554eaf1d3a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8292025-01-11T05:30:45.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a9a1af7-7fa3-43e9-84df-646981aca4d7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8302025-01-11T05:30:45.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a9a1af7-7fa3-43e9-84df-646981aca4d7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8312025-01-11T05:30:45.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a9a1af7-7fa3-43e9-84df-646981aca4d7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8322025-01-11T05:30:46.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cbd7f6d3-dab5-4474-b217-b8fe16843515 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8332025-01-11T05:30:46.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cbd7f6d3-dab5-4474-b217-b8fe16843515 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8342025-01-11T05:30:46.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cbd7f6d3-dab5-4474-b217-b8fe16843515 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8352025-01-11T05:30:47.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f39113db-b14d-484c-b5a6-dfcb6c14de1b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8362025-01-11T05:30:47.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f39113db-b14d-484c-b5a6-dfcb6c14de1b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8372025-01-11T05:30:47.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f39113db-b14d-484c-b5a6-dfcb6c14de1b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8382025-01-11T05:30:48.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 67519635-cfeb-41e2-abd0-9ae70635b201 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8392025-01-11T05:30:48.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 67519635-cfeb-41e2-abd0-9ae70635b201 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8402025-01-11T05:30:48.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 67519635-cfeb-41e2-abd0-9ae70635b201 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8412025-01-11T05:30:49.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b62ad8a3-7f90-4ccd-86f7-b5c4b1984448 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8422025-01-11T05:30:49.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b62ad8a3-7f90-4ccd-86f7-b5c4b1984448 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8432025-01-11T05:30:49.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b62ad8a3-7f90-4ccd-86f7-b5c4b1984448 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8442025-01-11T05:30:50.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 808c1d61-f899-44b3-9d4a-0fe06b09e6ac roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8452025-01-11T05:30:50.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 808c1d61-f899-44b3-9d4a-0fe06b09e6ac resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8462025-01-11T05:30:50.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 808c1d61-f899-44b3-9d4a-0fe06b09e6ac response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8472025-01-11T05:30:50.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
8482025-01-11T05:30:50.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
8492025-01-11T05:30:50.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8502025-01-11T05:30:50.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8512025-01-11T05:30:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8522025-01-11T05:30:50.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8532025-01-11T05:30:50.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8542025-01-11T05:30:50.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8552025-01-11T05:30:50.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8562025-01-11T05:30:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8572025-01-11T05:30:50.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8582025-01-11T05:30:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8592025-01-11T05:30:50.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8602025-01-11T05:30:50.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8612025-01-11T05:30:50.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622025-01-11T05:30:50.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
8632025-01-11T05:30:50.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8642025-01-11T05:30:50.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8652025-01-11T05:30:50.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
8662025-01-11T05:30:50.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.370649ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
8672025-01-11T05:30:50.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.884786ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8682025-01-11T05:30:51.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bc9a72fd-0872-40f4-b45e-bad574f9692b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8692025-01-11T05:30:51.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bc9a72fd-0872-40f4-b45e-bad574f9692b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8702025-01-11T05:30:51.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bc9a72fd-0872-40f4-b45e-bad574f9692b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8712025-01-11T05:30:52.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7258b568-67a4-42c7-840f-544cbd5ad3dc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8722025-01-11T05:30:52.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7258b568-67a4-42c7-840f-544cbd5ad3dc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8732025-01-11T05:30:52.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7258b568-67a4-42c7-840f-544cbd5ad3dc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8742025-01-11T05:30:53.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 95e35da1-4ba3-45ea-b6a8-0c107a85cb16 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8752025-01-11T05:30:53.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 95e35da1-4ba3-45ea-b6a8-0c107a85cb16 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8762025-01-11T05:30:53.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 95e35da1-4ba3-45ea-b6a8-0c107a85cb16 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8772025-01-11T05:30:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 1d3629a7-48fb-402a-aeed-10d212df9745 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
8782025-01-11T05:30:54.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f0ce6ce-b164-49f5-a8a2-de3f04c923b0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8792025-01-11T05:30:54.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f0ce6ce-b164-49f5-a8a2-de3f04c923b0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8802025-01-11T05:30:54.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f0ce6ce-b164-49f5-a8a2-de3f04c923b0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8812025-01-11T05:30:55.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 65a4812f-7f3a-4fa0-b223-dc9856075321 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8822025-01-11T05:30:55.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 65a4812f-7f3a-4fa0-b223-dc9856075321 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8832025-01-11T05:30:55.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 65a4812f-7f3a-4fa0-b223-dc9856075321 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8842025-01-11T05:30:56.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = db71f931-5da8-4201-9f53-0cd87a81dc99 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8852025-01-11T05:30:56.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = db71f931-5da8-4201-9f53-0cd87a81dc99 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8862025-01-11T05:30:56.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = db71f931-5da8-4201-9f53-0cd87a81dc99 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8872025-01-11T05:30:57.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8821c073-6c87-496a-81d3-a9c559d707b3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8882025-01-11T05:30:57.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8821c073-6c87-496a-81d3-a9c559d707b3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8892025-01-11T05:30:57.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8821c073-6c87-496a-81d3-a9c559d707b3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8902025-01-11T05:30:58.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b801ab95-765b-48f9-97e2-63298e8e489d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8912025-01-11T05:30:58.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b801ab95-765b-48f9-97e2-63298e8e489d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8922025-01-11T05:30:58.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b801ab95-765b-48f9-97e2-63298e8e489d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8932025-01-11T05:30:59.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52cf8e12-9c91-4315-a4a3-4ffc2047accc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8942025-01-11T05:30:59.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52cf8e12-9c91-4315-a4a3-4ffc2047accc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8952025-01-11T05:30:59.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52cf8e12-9c91-4315-a4a3-4ffc2047accc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
8962025-01-11T05:31:00.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
8972025-01-11T05:31:00.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8982025-01-11T05:31:00.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
8992025-01-11T05:31:00.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9002025-01-11T05:31:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9012025-01-11T05:31:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9022025-01-11T05:31:00.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9032025-01-11T05:31:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9042025-01-11T05:31:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9052025-01-11T05:31:00.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.08292ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9062025-01-11T05:31:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9072025-01-11T05:31:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9082025-01-11T05:31:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9092025-01-11T05:31:00.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9102025-01-11T05:31:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9112025-01-11T05:31:00.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122025-01-11T05:31:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
9132025-01-11T05:31:00.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9142025-01-11T05:31:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9152025-01-11T05:31:00.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
9162025-01-11T05:31:00.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.670866ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
9172025-01-11T05:31:00.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1cda8a1a-d2ff-47da-802a-3ede50ab174b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9182025-01-11T05:31:00.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1cda8a1a-d2ff-47da-802a-3ede50ab174b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9192025-01-11T05:31:00.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1cda8a1a-d2ff-47da-802a-3ede50ab174b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9202025-01-11T05:31:01.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 448836c4-c6d1-48ec-a3a7-8c0c56ae51b5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9212025-01-11T05:31:01.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 448836c4-c6d1-48ec-a3a7-8c0c56ae51b5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9222025-01-11T05:31:01.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 448836c4-c6d1-48ec-a3a7-8c0c56ae51b5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9232025-01-11T05:31:02.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 90094fb6-124e-40c8-bf3b-a241f91d8dc4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9242025-01-11T05:31:02.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 90094fb6-124e-40c8-bf3b-a241f91d8dc4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9252025-01-11T05:31:02.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 90094fb6-124e-40c8-bf3b-a241f91d8dc4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9262025-01-11T05:31:03.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ad5214e9-691d-47b0-9d6f-312a0bafbf9a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9272025-01-11T05:31:03.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ad5214e9-691d-47b0-9d6f-312a0bafbf9a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9282025-01-11T05:31:03.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ad5214e9-691d-47b0-9d6f-312a0bafbf9a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9292025-01-11T05:31:03.784ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 51d25f39-1fec-4c9f-b480-cb10ebb122d0 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
9302025-01-11T05:31:04.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 49157a9c-172e-4ea4-b330-b9b9e5e2eafc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9312025-01-11T05:31:04.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 49157a9c-172e-4ea4-b330-b9b9e5e2eafc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9322025-01-11T05:31:04.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 49157a9c-172e-4ea4-b330-b9b9e5e2eafc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9332025-01-11T05:31:05.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d50b8380-ada2-487a-94da-238ae9b06681 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9342025-01-11T05:31:05.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d50b8380-ada2-487a-94da-238ae9b06681 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9352025-01-11T05:31:05.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d50b8380-ada2-487a-94da-238ae9b06681 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9362025-01-11T05:31:06.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a9fa132f-b2f0-4503-bb8a-e999f3273d67 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9372025-01-11T05:31:06.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a9fa132f-b2f0-4503-bb8a-e999f3273d67 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9382025-01-11T05:31:06.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a9fa132f-b2f0-4503-bb8a-e999f3273d67 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9392025-01-11T05:31:07.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6b1093d6-ac48-4034-ac2c-38a7022fb062 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9402025-01-11T05:31:07.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6b1093d6-ac48-4034-ac2c-38a7022fb062 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9412025-01-11T05:31:07.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6b1093d6-ac48-4034-ac2c-38a7022fb062 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9422025-01-11T05:31:08.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7ed6741b-9a6c-42ac-b403-55b649afdc2d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9432025-01-11T05:31:08.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7ed6741b-9a6c-42ac-b403-55b649afdc2d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9442025-01-11T05:31:08.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7ed6741b-9a6c-42ac-b403-55b649afdc2d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9452025-01-11T05:31:09.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0a0a08bf-0450-4ee0-8fcf-17536c6ab0f1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9462025-01-11T05:31:09.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0a0a08bf-0450-4ee0-8fcf-17536c6ab0f1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9472025-01-11T05:31:09.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0a0a08bf-0450-4ee0-8fcf-17536c6ab0f1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
9482025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
9492025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
9502025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9512025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9522025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
9532025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
9542025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9552025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
9562025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
9572025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9582025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9592025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
9602025-01-11T05:31:10.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9612025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9622025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
9632025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9642025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
9652025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9662025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9672025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
9682025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9692025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
9702025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9712025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
9722025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9732025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
9742025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9752025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
9762025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9772025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
9782025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9792025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
9802025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9812025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
9822025-01-11T05:31:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9832025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9842025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9852025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9862025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9872025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9882025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9892025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9902025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9912025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9922025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9932025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9942025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9952025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9962025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9972025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9982025-01-11T05:31:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9992025-01-11T05:31:10.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002025-01-11T05:31:10.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10012025-01-11T05:31:10.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10022025-01-11T05:31:10.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10032025-01-11T05:31:10.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.476866ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10042025-01-11T05:31:10.607ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10052025-01-11T05:31:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10062025-01-11T05:31:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10072025-01-11T05:31:10.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10082025-01-11T05:31:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10092025-01-11T05:31:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10102025-01-11T05:31:10.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10112025-01-11T05:31:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10122025-01-11T05:31:10.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132025-01-11T05:31:10.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10142025-01-11T05:31:10.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10152025-01-11T05:31:10.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10162025-01-11T05:31:10.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10172025-01-11T05:31:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10182025-01-11T05:31:10.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10192025-01-11T05:31:10.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10202025-01-11T05:31:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10212025-01-11T05:31:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10222025-01-11T05:31:10.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10232025-01-11T05:31:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10242025-01-11T05:31:10.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10252025-01-11T05:31:10.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262025-01-11T05:31:10.617ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1410, tv_nsec: 173560640 } })
10272025-01-11T05:31:10.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10282025-01-11T05:31:10.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.908169ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10292025-01-11T05:31:10.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1410, tv_nsec: 174720075 } })
10302025-01-11T05:31:10.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10312025-01-11T05:31:10.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10322025-01-11T05:31:10.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10332025-01-11T05:31:10.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10342025-01-11T05:31:10.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10352025-01-11T05:31:10.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10362025-01-11T05:31:10.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10372025-01-11T05:31:10.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.447339ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10382025-01-11T05:31:10.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10392025-01-11T05:31:10.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402025-01-11T05:31:10.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10412025-01-11T05:31:10.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10422025-01-11T05:31:10.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432025-01-11T05:31:10.629ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1410, tv_nsec: 184782265 } })
10442025-01-11T05:31:10.629ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10452025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10462025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10472025-01-11T05:31:10.629ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
10482025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10492025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10502025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10512025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10522025-01-11T05:31:10.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10532025-01-11T05:31:10.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10542025-01-11T05:31:10.630ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10552025-01-11T05:31:10.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562025-01-11T05:31:10.630ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.086415ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10572025-01-11T05:31:10.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582025-01-11T05:31:10.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10592025-01-11T05:31:10.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10602025-01-11T05:31:10.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10612025-01-11T05:31:10.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
10622025-01-11T05:31:10.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10632025-01-11T05:31:10.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10642025-01-11T05:31:10.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.490592ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
10652025-01-11T05:31:10.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10662025-01-11T05:31:10.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10672025-01-11T05:31:10.648ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
10682025-01-11T05:31:10.648ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.116539ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
10692025-01-11T05:31:10.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.186871ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
10702025-01-11T05:31:10.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10712025-01-11T05:31:10.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10722025-01-11T05:31:10.651ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10732025-01-11T05:31:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10742025-01-11T05:31:10.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.552727ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10752025-01-11T05:31:10.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10762025-01-11T05:31:10.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10772025-01-11T05:31:10.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10782025-01-11T05:31:10.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10792025-01-11T05:31:10.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10802025-01-11T05:31:10.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10812025-01-11T05:31:10.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822025-01-11T05:31:10.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10832025-01-11T05:31:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10842025-01-11T05:31:10.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852025-01-11T05:31:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
10862025-01-11T05:31:10.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10872025-01-11T05:31:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10882025-01-11T05:31:10.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10892025-01-11T05:31:10.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10902025-01-11T05:31:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10912025-01-11T05:31:10.673ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.34945ms iteration = 16 status = 0
10922025-01-11T05:31:10.673ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10932025-01-11T05:31:10.673ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10942025-01-11T05:31:10.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.510013ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10952025-01-11T05:31:10.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962025-01-11T05:31:10.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10972025-01-11T05:31:10.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10982025-01-11T05:31:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10992025-01-11T05:31:10.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.589755ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11002025-01-11T05:31:10.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11012025-01-11T05:31:10.702ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11022025-01-11T05:31:10.702ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d950122-3eda-4773-babe-3c7a3e5f0782", "content-length": "26", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11032025-01-11T05:31:10.702ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11042025-01-11T05:31:10.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11052025-01-11T05:31:10.737ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.412022ms iteration = 18 status = {"physical_disks_added":0}
11062025-01-11T05:31:10.833ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11072025-01-11T05:31:10.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11082025-01-11T05:31:10.834ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6c7750f-3b29-4de8-a493-53226ebabbf8", "content-length": "372", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11092025-01-11T05:31:10.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11102025-01-11T05:31:10.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11112025-01-11T05:31:10.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11122025-01-11T05:31:10.861ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ae38d11-cd20-4fc6-a6e9-66c19d19d391", "content-length": "691", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11132025-01-11T05:31:10.861ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11142025-01-11T05:31:10.861ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11152025-01-11T05:31:10.861ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11162025-01-11T05:31:10.861ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.206544ms iteration = 16 status = {}
11172025-01-11T05:31:10.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
11182025-01-11T05:31:10.873ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11192025-01-11T05:31:10.873ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93dd51d5-ab21-4a33-ab11-8fb7c6decc55", "content-length": "26", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11202025-01-11T05:31:10.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11212025-01-11T05:31:10.874ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
11222025-01-11T05:31:10.875ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11232025-01-11T05:31:10.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11242025-01-11T05:31:10.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2d1f5d88-a1ae-48fa-8bc9-2f84d4b1ca15", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11252025-01-11T05:31:10.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11262025-01-11T05:31:10.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11272025-01-11T05:31:10.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11282025-01-11T05:31:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11292025-01-11T05:31:10.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11302025-01-11T05:31:10.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11312025-01-11T05:31:10.884ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11322025-01-11T05:31:10.884ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11332025-01-11T05:31:10.884ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fbf2f08-24a8-41aa-8379-edf9eb5bad70", "content-length": "26", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11342025-01-11T05:31:10.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11352025-01-11T05:31:10.884ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11362025-01-11T05:31:10.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11372025-01-11T05:31:10.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e28f6e3a-b477-4f2f-8822-d536f84b7f11", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11382025-01-11T05:31:10.886ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.722461ms iteration = 16 status = {}
11392025-01-11T05:31:10.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11402025-01-11T05:31:10.922ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11412025-01-11T05:31:10.923ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "58f1ab19-0dbb-4ae5-aab0-96fd774480b1", "content-length": "1", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11422025-01-11T05:31:10.925ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11432025-01-11T05:31:10.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11442025-01-11T05:31:10.927ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 324.33725ms iteration = 16 status = null
11452025-01-11T05:31:10.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4343799-221a-403a-8679-2d8c61a0c35a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11462025-01-11T05:31:10.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4343799-221a-403a-8679-2d8c61a0c35a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11472025-01-11T05:31:10.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4343799-221a-403a-8679-2d8c61a0c35a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11482025-01-11T05:31:10.942ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.576034ms iteration = 16 status = {}
11492025-01-11T05:31:10.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11502025-01-11T05:31:10.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11512025-01-11T05:31:10.999ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
11522025-01-11T05:31:10.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11532025-01-11T05:31:11.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11542025-01-11T05:31:11.006ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11552025-01-11T05:31:11.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "257e0574-b508-4561-9ff2-c9a4aa6d4db0", "content-length": "134", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11562025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11572025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
11582025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11592025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11602025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11612025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11622025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11632025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11642025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11652025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11662025-01-11T05:31:11.007ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
11672025-01-11T05:31:11.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11682025-01-11T05:31:11.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11692025-01-11T05:31:11.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11702025-01-11T05:31:11.009ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c174a8c7-ff7b-4400-bf1d-c08000974547", "content-length": "2", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11712025-01-11T05:31:11.009ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11722025-01-11T05:31:11.010ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9582932-31c4-498a-bb96-8f1316e6129d", "content-length": "52", "date": "Sat, 11 Jan 2025 05:31:11 GMT"} })
11732025-01-11T05:31:11.010ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
11742025-01-11T05:31:11.010ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11752025-01-11T05:31:11.110ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "73ecd927-ca9d-42b3-a62f-8abe538b468a", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11762025-01-11T05:31:11.110ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
11772025-01-11T05:31:11.110ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11782025-01-11T05:31:11.111ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "630f66c8-de1c-49d8-ac55-a62662a5ec27", "content-length": "682", "date": "Sat, 11 Jan 2025 05:31:10 GMT"} })
11792025-01-11T05:31:11.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11802025-01-11T05:31:11.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11812025-01-11T05:31:11.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11822025-01-11T05:31:11.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11832025-01-11T05:31:11.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11842025-01-11T05:31:11.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11852025-01-11T05:31:11.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11862025-01-11T05:31:11.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11872025-01-11T05:31:11.127ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 524.173195ms iteration = 16 status = {}
11882025-01-11T05:31:11.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = bd1395dd-328f-4ab0-ba1b-b4c9f158a88e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11892025-01-11T05:31:11.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = bd1395dd-328f-4ab0-ba1b-b4c9f158a88e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11902025-01-11T05:31:11.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = bd1395dd-328f-4ab0-ba1b-b4c9f158a88e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
11912025-01-11T05:31:12.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3adbe9d3-e183-4f8d-bc41-2983b4153b70 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11922025-01-11T05:31:12.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3adbe9d3-e183-4f8d-bc41-2983b4153b70 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11932025-01-11T05:31:12.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3adbe9d3-e183-4f8d-bc41-2983b4153b70 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11942025-01-11T05:31:13.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ac58ac1-0262-4024-ae13-47e1727187ab roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11952025-01-11T05:31:13.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ac58ac1-0262-4024-ae13-47e1727187ab resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11962025-01-11T05:31:13.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ac58ac1-0262-4024-ae13-47e1727187ab response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11972025-01-11T05:31:13.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 615 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = bd27a95e-1d2a-4e61-b211-d4120c85d9b8 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
11982025-01-11T05:31:14.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aaddd7b6-97b3-4f25-baf9-5948efa1fcb4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
11992025-01-11T05:31:14.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aaddd7b6-97b3-4f25-baf9-5948efa1fcb4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12002025-01-11T05:31:14.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aaddd7b6-97b3-4f25-baf9-5948efa1fcb4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12012025-01-11T05:31:15.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d92c4ccf-96de-4382-9fd5-029da56aed35 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12022025-01-11T05:31:15.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d92c4ccf-96de-4382-9fd5-029da56aed35 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12032025-01-11T05:31:15.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d92c4ccf-96de-4382-9fd5-029da56aed35 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12042025-01-11T05:31:16.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d3ac772d-b62b-4cdb-9003-4cd052e546d7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12052025-01-11T05:31:16.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d3ac772d-b62b-4cdb-9003-4cd052e546d7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12062025-01-11T05:31:16.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d3ac772d-b62b-4cdb-9003-4cd052e546d7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12072025-01-11T05:31:17.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d56fb926-f913-4d4f-92f1-681d9d618e10 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12082025-01-11T05:31:17.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d56fb926-f913-4d4f-92f1-681d9d618e10 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12092025-01-11T05:31:17.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d56fb926-f913-4d4f-92f1-681d9d618e10 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12102025-01-11T05:31:18.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9438dc20-c646-4fe1-a149-c56b59d92d6f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12112025-01-11T05:31:18.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9438dc20-c646-4fe1-a149-c56b59d92d6f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12122025-01-11T05:31:18.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9438dc20-c646-4fe1-a149-c56b59d92d6f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12132025-01-11T05:31:19.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ecda4653-8211-4c5a-b53e-c3d6eaa68599 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12142025-01-11T05:31:19.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ecda4653-8211-4c5a-b53e-c3d6eaa68599 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12152025-01-11T05:31:19.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ecda4653-8211-4c5a-b53e-c3d6eaa68599 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12162025-01-11T05:31:20.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c7ede73c-0735-4ab2-b668-b18ce82679d0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12172025-01-11T05:31:20.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c7ede73c-0735-4ab2-b668-b18ce82679d0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12182025-01-11T05:31:20.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c7ede73c-0735-4ab2-b668-b18ce82679d0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12192025-01-11T05:31:20.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
12202025-01-11T05:31:20.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
12212025-01-11T05:31:20.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12222025-01-11T05:31:20.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12232025-01-11T05:31:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12242025-01-11T05:31:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12252025-01-11T05:31:20.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12262025-01-11T05:31:20.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12272025-01-11T05:31:20.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12282025-01-11T05:31:20.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.136288ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12292025-01-11T05:31:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12302025-01-11T05:31:20.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12312025-01-11T05:31:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12322025-01-11T05:31:20.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12332025-01-11T05:31:20.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342025-01-11T05:31:20.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12352025-01-11T05:31:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
12362025-01-11T05:31:20.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12372025-01-11T05:31:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12382025-01-11T05:31:20.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
12392025-01-11T05:31:20.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.794874ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
12402025-01-11T05:31:21.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e0a76b2-d49b-4a95-8534-168d180d5e27 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12412025-01-11T05:31:21.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e0a76b2-d49b-4a95-8534-168d180d5e27 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12422025-01-11T05:31:21.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e0a76b2-d49b-4a95-8534-168d180d5e27 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12432025-01-11T05:31:22.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e04db2b-e89a-4546-ad5f-378dfde991dd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12442025-01-11T05:31:22.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e04db2b-e89a-4546-ad5f-378dfde991dd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12452025-01-11T05:31:22.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e04db2b-e89a-4546-ad5f-378dfde991dd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12462025-01-11T05:31:23.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2efe9d58-f690-4252-95ba-bfe1dd1ee259 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12472025-01-11T05:31:23.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2efe9d58-f690-4252-95ba-bfe1dd1ee259 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12482025-01-11T05:31:23.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2efe9d58-f690-4252-95ba-bfe1dd1ee259 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12492025-01-11T05:31:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 071e2ffe-cae1-498e-a1f4-bb2b68043c05 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
12502025-01-11T05:31:24.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 01cfd16f-90a5-4aa0-b451-401291d58f40 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12512025-01-11T05:31:24.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 01cfd16f-90a5-4aa0-b451-401291d58f40 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12522025-01-11T05:31:24.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 01cfd16f-90a5-4aa0-b451-401291d58f40 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12532025-01-11T05:31:25.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 435335d5-b21e-4b5c-92ce-fe5e8766c0ed roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12542025-01-11T05:31:25.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 435335d5-b21e-4b5c-92ce-fe5e8766c0ed resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12552025-01-11T05:31:25.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 435335d5-b21e-4b5c-92ce-fe5e8766c0ed response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12562025-01-11T05:31:26.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdbd4315-746d-4760-9674-618a2eb626db roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12572025-01-11T05:31:26.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdbd4315-746d-4760-9674-618a2eb626db resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12582025-01-11T05:31:26.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdbd4315-746d-4760-9674-618a2eb626db response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12592025-01-11T05:31:27.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2c9b9de3-08ed-405a-b61c-6720eb38ad34 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12602025-01-11T05:31:27.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2c9b9de3-08ed-405a-b61c-6720eb38ad34 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12612025-01-11T05:31:27.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2c9b9de3-08ed-405a-b61c-6720eb38ad34 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12622025-01-11T05:31:28.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 20368509-d924-48b5-972f-4d66090a9b32 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12632025-01-11T05:31:28.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 20368509-d924-48b5-972f-4d66090a9b32 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12642025-01-11T05:31:28.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 20368509-d924-48b5-972f-4d66090a9b32 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12652025-01-11T05:31:29.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f385d5a3-bf1a-49b3-b68e-38396a0c60f6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12662025-01-11T05:31:29.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f385d5a3-bf1a-49b3-b68e-38396a0c60f6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12672025-01-11T05:31:29.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f385d5a3-bf1a-49b3-b68e-38396a0c60f6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12682025-01-11T05:31:30.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5aa355e4-ee7b-44e3-9ed6-5d05814073d7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12692025-01-11T05:31:30.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5aa355e4-ee7b-44e3-9ed6-5d05814073d7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12702025-01-11T05:31:30.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5aa355e4-ee7b-44e3-9ed6-5d05814073d7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12712025-01-11T05:31:30.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
12722025-01-11T05:31:30.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12732025-01-11T05:31:30.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
12742025-01-11T05:31:30.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12752025-01-11T05:31:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12762025-01-11T05:31:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772025-01-11T05:31:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12782025-01-11T05:31:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12792025-01-11T05:31:30.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12802025-01-11T05:31:30.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.895316ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12812025-01-11T05:31:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12822025-01-11T05:31:30.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12832025-01-11T05:31:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12842025-01-11T05:31:30.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12852025-01-11T05:31:30.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12862025-01-11T05:31:30.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872025-01-11T05:31:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
12882025-01-11T05:31:30.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12892025-01-11T05:31:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12902025-01-11T05:31:30.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
12912025-01-11T05:31:30.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.738362ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
12922025-01-11T05:31:31.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 63aaf156-3fb7-42a1-9943-f006d050902b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12932025-01-11T05:31:31.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 63aaf156-3fb7-42a1-9943-f006d050902b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12942025-01-11T05:31:31.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 63aaf156-3fb7-42a1-9943-f006d050902b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12952025-01-11T05:31:32.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0219e521-a708-440e-9ecd-6fecef0e4116 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12962025-01-11T05:31:32.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0219e521-a708-440e-9ecd-6fecef0e4116 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12972025-01-11T05:31:32.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0219e521-a708-440e-9ecd-6fecef0e4116 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12982025-01-11T05:31:33.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 29f6b1e6-ce0b-4862-b72c-aab2d4ee227d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
12992025-01-11T05:31:33.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 29f6b1e6-ce0b-4862-b72c-aab2d4ee227d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13002025-01-11T05:31:33.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 29f6b1e6-ce0b-4862-b72c-aab2d4ee227d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13012025-01-11T05:31:33.784ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 9f90f58c-798b-41a5-b9cb-8b7abbf338e9 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
13022025-01-11T05:31:34.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 32b7221d-0c06-41f9-a83d-d3bde4d63fd1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13032025-01-11T05:31:34.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 32b7221d-0c06-41f9-a83d-d3bde4d63fd1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13042025-01-11T05:31:34.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 32b7221d-0c06-41f9-a83d-d3bde4d63fd1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13052025-01-11T05:31:35.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51c772ae-48de-4d4c-984d-9de978b7cdc0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13062025-01-11T05:31:35.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51c772ae-48de-4d4c-984d-9de978b7cdc0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13072025-01-11T05:31:35.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51c772ae-48de-4d4c-984d-9de978b7cdc0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13082025-01-11T05:31:36.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c00955da-783a-47b5-b6dc-c6739d720eda roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13092025-01-11T05:31:36.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c00955da-783a-47b5-b6dc-c6739d720eda resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13102025-01-11T05:31:36.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c00955da-783a-47b5-b6dc-c6739d720eda response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13112025-01-11T05:31:37.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 33bef4e8-30e2-4cf9-b58c-e421870553c4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13122025-01-11T05:31:37.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 33bef4e8-30e2-4cf9-b58c-e421870553c4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13132025-01-11T05:31:37.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 33bef4e8-30e2-4cf9-b58c-e421870553c4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13142025-01-11T05:31:38.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9dc7a093-6cf8-4e9c-b9d1-0271c7631992 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13152025-01-11T05:31:38.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9dc7a093-6cf8-4e9c-b9d1-0271c7631992 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13162025-01-11T05:31:38.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9dc7a093-6cf8-4e9c-b9d1-0271c7631992 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13172025-01-11T05:31:38.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = dc131c4d-798c-48ac-bcd9-7c5b57369746 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
13182025-01-11T05:31:38.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = dc131c4d-798c-48ac-bcd9-7c5b57369746 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
13192025-01-11T05:31:38.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = dc131c4d-798c-48ac-bcd9-7c5b57369746 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
13202025-01-11T05:31:38.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 6bedce36-04fa-4b5d-b2b4-c1d27ac8369e roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
13212025-01-11T05:31:38.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 6bedce36-04fa-4b5d-b2b4-c1d27ac8369e resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
13222025-01-11T05:31:38.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 6bedce36-04fa-4b5d-b2b4-c1d27ac8369e response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
13232025-01-11T05:31:39.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58891c46-0287-4184-a98c-6222d60f67d2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13242025-01-11T05:31:39.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58891c46-0287-4184-a98c-6222d60f67d2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13252025-01-11T05:31:39.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58891c46-0287-4184-a98c-6222d60f67d2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
13262025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
13272025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
13282025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13292025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13302025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
13312025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13322025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13332025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
13342025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13352025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13362025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
13372025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
13382025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13392025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13402025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
13412025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13422025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
13432025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13442025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13452025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
13462025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13472025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
13482025-01-11T05:31:40.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
13492025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
13502025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.69\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
13512025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13522025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
13532025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
13542025-01-11T05:31:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13552025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13562025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
13572025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13582025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13592025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13602025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
13612025-01-11T05:31:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13622025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
13632025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13642025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13652025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13662025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13672025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
13682025-01-11T05:31:40.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:21:40.602762635 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13692025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13702025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
13712025-01-11T05:31:40.603ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13722025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13732025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
13742025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13752025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
13762025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13772025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13782025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
13792025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
13802025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13812025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
13822025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13832025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
13842025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
13852025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13862025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
13872025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13882025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13892025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13902025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13912025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13922025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13932025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13942025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13952025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13962025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13972025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13982025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13992025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14002025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14012025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14022025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14042025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14052025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14062025-01-11T05:31:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 159711741 } })
14072025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14082025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14092025-01-11T05:31:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14102025-01-11T05:31:40.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 159777392 } })
14112025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14122025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14132025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14142025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14152025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.947122ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14162025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14172025-01-11T05:31:40.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.796899ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14182025-01-11T05:31:40.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192025-01-11T05:31:40.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.968065ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
14202025-01-11T05:31:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.590189ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14212025-01-11T05:31:40.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 162579594 } })
14222025-01-11T05:31:40.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14232025-01-11T05:31:40.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14242025-01-11T05:31:40.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14252025-01-11T05:31:40.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14262025-01-11T05:31:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14272025-01-11T05:31:40.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14282025-01-11T05:31:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14292025-01-11T05:31:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14302025-01-11T05:31:40.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14312025-01-11T05:31:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14322025-01-11T05:31:40.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14332025-01-11T05:31:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14342025-01-11T05:31:40.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14352025-01-11T05:31:40.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14362025-01-11T05:31:40.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 166766455 } })
14372025-01-11T05:31:40.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14382025-01-11T05:31:40.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392025-01-11T05:31:40.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402025-01-11T05:31:40.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412025-01-11T05:31:40.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14422025-01-11T05:31:40.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14432025-01-11T05:31:40.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14442025-01-11T05:31:40.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14452025-01-11T05:31:40.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14462025-01-11T05:31:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14472025-01-11T05:31:40.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14482025-01-11T05:31:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14492025-01-11T05:31:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14502025-01-11T05:31:40.616ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:21:40.602762635 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14512025-01-11T05:31:40.616ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.808242ms iteration = 9 status = {"expiration":"2025-01-11T05:21:40.602762635Z","pruned":[]}
14522025-01-11T05:31:40.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532025-01-11T05:31:40.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14542025-01-11T05:31:40.618ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14552025-01-11T05:31:40.618ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14562025-01-11T05:31:40.618ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.53322ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14572025-01-11T05:31:40.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582025-01-11T05:31:40.619ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.151734ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
14592025-01-11T05:31:40.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14602025-01-11T05:31:40.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14612025-01-11T05:31:40.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14622025-01-11T05:31:40.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14632025-01-11T05:31:40.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14642025-01-11T05:31:40.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14652025-01-11T05:31:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14662025-01-11T05:31:40.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14672025-01-11T05:31:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14682025-01-11T05:31:40.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692025-01-11T05:31:40.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14702025-01-11T05:31:40.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14712025-01-11T05:31:40.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.189431ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14722025-01-11T05:31:40.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14732025-01-11T05:31:40.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14742025-01-11T05:31:40.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14752025-01-11T05:31:40.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762025-01-11T05:31:40.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14772025-01-11T05:31:40.635ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1440, tv_nsec: 191699961 } })
14782025-01-11T05:31:40.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14792025-01-11T05:31:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14802025-01-11T05:31:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14812025-01-11T05:31:40.636ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
14822025-01-11T05:31:40.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832025-01-11T05:31:40.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14842025-01-11T05:31:40.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14852025-01-11T05:31:40.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14862025-01-11T05:31:40.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14872025-01-11T05:31:40.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14882025-01-11T05:31:40.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14892025-01-11T05:31:40.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902025-01-11T05:31:40.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14912025-01-11T05:31:40.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14922025-01-11T05:31:40.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14932025-01-11T05:31:40.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14942025-01-11T05:31:40.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c16fd4d9-fa70-45ab-a0f2-6ff23ed64d70 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
14952025-01-11T05:31:40.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14962025-01-11T05:31:40.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c16fd4d9-fa70-45ab-a0f2-6ff23ed64d70 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
14972025-01-11T05:31:40.651ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14982025-01-11T05:31:40.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14992025-01-11T05:31:40.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15002025-01-11T05:31:40.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15012025-01-11T05:31:40.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15022025-01-11T05:31:40.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15032025-01-11T05:31:40.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15042025-01-11T05:31:40.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15052025-01-11T05:31:40.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15062025-01-11T05:31:40.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15072025-01-11T05:31:40.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.123764ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
15082025-01-11T05:31:40.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15092025-01-11T05:31:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15102025-01-11T05:31:40.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112025-01-11T05:31:40.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15122025-01-11T05:31:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15132025-01-11T05:31:40.669ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15142025-01-11T05:31:40.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15152025-01-11T05:31:40.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15162025-01-11T05:31:40.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15172025-01-11T05:31:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15182025-01-11T05:31:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15192025-01-11T05:31:40.673ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15202025-01-11T05:31:40.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.519496ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15212025-01-11T05:31:40.674ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15222025-01-11T05:31:40.674ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15232025-01-11T05:31:40.674ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.594907ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15242025-01-11T05:31:40.675ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15252025-01-11T05:31:40.675ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15262025-01-11T05:31:40.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15272025-01-11T05:31:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15282025-01-11T05:31:40.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15292025-01-11T05:31:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
15302025-01-11T05:31:40.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15312025-01-11T05:31:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15322025-01-11T05:31:40.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15332025-01-11T05:31:40.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15342025-01-11T05:31:40.709ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15352025-01-11T05:31:40.709ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15362025-01-11T05:31:40.710ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15372025-01-11T05:31:40.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15382025-01-11T05:31:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15392025-01-11T05:31:40.756ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15402025-01-11T05:31:40.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15412025-01-11T05:31:40.759ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15422025-01-11T05:31:40.760ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7da974ab-866d-4fb3-a134-d0a6864e9bfe", "content-length": "26", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
15432025-01-11T05:31:40.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15442025-01-11T05:31:40.761ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15452025-01-11T05:31:40.823ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
15462025-01-11T05:31:40.823ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15472025-01-11T05:31:40.823ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23bfa2bd-06cb-4628-8972-1b0db6fc97f3", "content-length": "26", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
15482025-01-11T05:31:40.823ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15492025-01-11T05:31:40.825ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
15502025-01-11T05:31:40.837ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15512025-01-11T05:31:40.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15522025-01-11T05:31:40.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "263cdd02-322c-4da2-9700-9566e0755796", "content-length": "372", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
15532025-01-11T05:31:40.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15542025-01-11T05:31:40.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15552025-01-11T05:31:40.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c16fd4d9-fa70-45ab-a0f2-6ff23ed64d70 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
15562025-01-11T05:31:40.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15572025-01-11T05:31:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15582025-01-11T05:31:40.844ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15592025-01-11T05:31:40.844ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15602025-01-11T05:31:40.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15612025-01-11T05:31:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15622025-01-11T05:31:40.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15632025-01-11T05:31:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
15642025-01-11T05:31:40.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15652025-01-11T05:31:40.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15662025-01-11T05:31:40.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 249.783348ms iteration = 17 status = 0
15672025-01-11T05:31:40.857ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
15682025-01-11T05:31:40.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 255.198777ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
15692025-01-11T05:31:40.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15702025-01-11T05:31:40.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 270.065782ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15712025-01-11T05:31:40.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 276.797939ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15722025-01-11T05:31:40.884ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15732025-01-11T05:31:40.884ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15742025-01-11T05:31:40.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 281.902631ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15752025-01-11T05:31:40.886ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
15762025-01-11T05:31:40.886ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 284.036598ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15772025-01-11T05:31:40.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782025-01-11T05:31:40.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15792025-01-11T05:31:40.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15802025-01-11T05:31:40.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15812025-01-11T05:31:40.890ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 287.661717ms iteration = 19 status = {"physical_disks_added":0}
15822025-01-11T05:31:40.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15832025-01-11T05:31:40.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15842025-01-11T05:31:40.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15852025-01-11T05:31:40.892ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15862025-01-11T05:31:40.892ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
15872025-01-11T05:31:40.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15882025-01-11T05:31:40.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15892025-01-11T05:31:40.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902025-01-11T05:31:40.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15912025-01-11T05:31:40.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15922025-01-11T05:31:40.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15932025-01-11T05:31:40.895ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15942025-01-11T05:31:40.895ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15952025-01-11T05:31:40.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15962025-01-11T05:31:40.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15972025-01-11T05:31:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15982025-01-11T05:31:40.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15992025-01-11T05:31:40.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16002025-01-11T05:31:40.899ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
16012025-01-11T05:31:40.899ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16022025-01-11T05:31:40.899ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
16032025-01-11T05:31:40.899ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 296.316296ms iteration = 9 status = {"generation":2}
16042025-01-11T05:31:40.907ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16052025-01-11T05:31:40.907ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16062025-01-11T05:31:40.908ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "798f5a0c-16f0-41fe-98ed-26483ba36939", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16072025-01-11T05:31:40.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16082025-01-11T05:31:40.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16092025-01-11T05:31:40.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16102025-01-11T05:31:40.909ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16112025-01-11T05:31:40.910ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de28864-81a7-4a2f-ae09-59cde7e29241", "content-length": "26", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16122025-01-11T05:31:40.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16132025-01-11T05:31:40.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16142025-01-11T05:31:40.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16152025-01-11T05:31:40.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16162025-01-11T05:31:40.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16172025-01-11T05:31:40.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16182025-01-11T05:31:40.915ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16192025-01-11T05:31:40.915ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "195f8ee6-4085-431f-8e3d-2be7352b3131", "content-length": "1", "date": "Sat, 11 Jan 2025 05:31:39 GMT"} })
16202025-01-11T05:31:40.917ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16212025-01-11T05:31:40.917ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16222025-01-11T05:31:40.917ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16232025-01-11T05:31:40.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16242025-01-11T05:31:40.917ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7ed40af3-184c-41f3-8991-3a2186fce179", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16252025-01-11T05:31:40.918ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16262025-01-11T05:31:40.918ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a8c4b756-abf2-4721-9145-c9eeaa47f9d3", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16272025-01-11T05:31:40.918ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16282025-01-11T05:31:40.919ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 317.123442ms iteration = 17 status = null
16292025-01-11T05:31:40.920ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.360347ms iteration = 17 status = {}
16302025-01-11T05:31:40.920ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ce811cf6-d75e-482b-bfbb-1480befc4892", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16312025-01-11T05:31:40.920ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16322025-01-11T05:31:40.921ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16332025-01-11T05:31:40.921ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 318.962362ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16342025-01-11T05:31:40.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 321.634821ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16352025-01-11T05:31:40.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16362025-01-11T05:31:40.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16372025-01-11T05:31:40.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16382025-01-11T05:31:40.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16392025-01-11T05:31:40.933ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16402025-01-11T05:31:40.933ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16412025-01-11T05:31:40.933ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
16422025-01-11T05:31:40.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 330.927624ms iteration = 9 status = {"generation":1}
16432025-01-11T05:31:40.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16442025-01-11T05:31:40.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16452025-01-11T05:31:40.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16462025-01-11T05:31:40.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16472025-01-11T05:31:40.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16482025-01-11T05:31:40.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16492025-01-11T05:31:40.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502025-01-11T05:31:40.950ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16512025-01-11T05:31:40.950ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 347.740372ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16522025-01-11T05:31:40.950ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16532025-01-11T05:31:40.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16542025-01-11T05:31:40.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16552025-01-11T05:31:40.987ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16562025-01-11T05:31:41.007ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 405.328723ms iteration = 17 status = {}
16572025-01-11T05:31:41.073ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16582025-01-11T05:31:41.074ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9d440ec1-28f9-4d4e-8f8b-64327921e16f", "date": "Sat, 11 Jan 2025 05:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16592025-01-11T05:31:41.074ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16602025-01-11T05:31:41.076ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e793871b-a678-4e06-8f97-a0840263fecf", "date": "Sat, 11 Jan 2025 05:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16612025-01-11T05:31:41.076ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16622025-01-11T05:31:41.078ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a5de6348-0995-45c1-9601-a7c33b8addbc", "date": "Sat, 11 Jan 2025 05:31:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16632025-01-11T05:31:41.078ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16642025-01-11T05:31:41.080ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16652025-01-11T05:31:41.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 478.564346ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16662025-01-11T05:31:41.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16672025-01-11T05:31:41.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a752d51-0f4d-4732-b80d-beffe0c5fb5a", "content-length": "691", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16682025-01-11T05:31:41.094ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16692025-01-11T05:31:41.094ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16702025-01-11T05:31:41.094ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16712025-01-11T05:31:41.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.868901ms iteration = 17 status = {}
16722025-01-11T05:31:41.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16732025-01-11T05:31:41.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16742025-01-11T05:31:41.107ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
16752025-01-11T05:31:41.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16762025-01-11T05:31:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16772025-01-11T05:31:41.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16782025-01-11T05:31:41.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd4a2c9-f747-4e9e-b50e-08cdb48b6424", "content-length": "134", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16792025-01-11T05:31:41.116ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16802025-01-11T05:31:41.116ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
16812025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16822025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16832025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16842025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16852025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16862025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16872025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16882025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16892025-01-11T05:31:41.117ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
16902025-01-11T05:31:41.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16912025-01-11T05:31:41.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16922025-01-11T05:31:41.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16932025-01-11T05:31:41.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a163de-983f-4cad-b504-61157d5cbf68", "content-length": "2", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16942025-01-11T05:31:41.120ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16952025-01-11T05:31:41.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "15d0568e-ef87-4745-b9be-e0a6b77b7d26", "content-length": "52", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16962025-01-11T05:31:41.120ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
16972025-01-11T05:31:41.120ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16982025-01-11T05:31:41.212ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1ebdbd46-7932-4116-8bb9-d746d88188bc", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
16992025-01-11T05:31:41.212ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
17002025-01-11T05:31:41.212ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17012025-01-11T05:31:41.212ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "323bc463-07de-4bf5-a3d0-31f0d0dcf6d0", "content-length": "682", "date": "Sat, 11 Jan 2025 05:31:40 GMT"} })
17022025-01-11T05:31:41.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17032025-01-11T05:31:41.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17042025-01-11T05:31:41.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17052025-01-11T05:31:41.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17062025-01-11T05:31:41.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17072025-01-11T05:31:41.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17082025-01-11T05:31:41.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17092025-01-11T05:31:41.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17102025-01-11T05:31:41.228ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.27443ms iteration = 17 status = {}
17112025-01-11T05:31:41.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8b699763-6d47-4c0a-9aff-fec9feaf7a04 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17122025-01-11T05:31:41.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8b699763-6d47-4c0a-9aff-fec9feaf7a04 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17132025-01-11T05:31:41.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8b699763-6d47-4c0a-9aff-fec9feaf7a04 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17142025-01-11T05:31:41.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4459b6ac-33d3-46da-923d-c70faea39db7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17152025-01-11T05:31:41.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4459b6ac-33d3-46da-923d-c70faea39db7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17162025-01-11T05:31:41.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4459b6ac-33d3-46da-923d-c70faea39db7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17172025-01-11T05:31:42.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7c85cf22-9d9c-43d5-a229-49972f3e6441 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17182025-01-11T05:31:42.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7c85cf22-9d9c-43d5-a229-49972f3e6441 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17192025-01-11T05:31:42.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7c85cf22-9d9c-43d5-a229-49972f3e6441 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17202025-01-11T05:31:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 32598b9a-d16f-46a2-bb7f-3ccf606db18f response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
17212025-01-11T05:31:43.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6399594a-2d5d-4786-b1e6-8e480e47d31b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17222025-01-11T05:31:43.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6399594a-2d5d-4786-b1e6-8e480e47d31b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17232025-01-11T05:31:43.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6399594a-2d5d-4786-b1e6-8e480e47d31b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17242025-01-11T05:31:44.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = abadefdd-11e9-4aa0-bd80-8aab506969e9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17252025-01-11T05:31:44.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = abadefdd-11e9-4aa0-bd80-8aab506969e9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17262025-01-11T05:31:44.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = abadefdd-11e9-4aa0-bd80-8aab506969e9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17272025-01-11T05:31:45.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 35f70e2e-c0ec-41fd-84d1-84182715b31f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17282025-01-11T05:31:45.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 35f70e2e-c0ec-41fd-84d1-84182715b31f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17292025-01-11T05:31:45.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 35f70e2e-c0ec-41fd-84d1-84182715b31f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17302025-01-11T05:31:46.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 07e22bbc-ab2e-4adf-8e14-7cdb9a019bd2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17312025-01-11T05:31:46.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 07e22bbc-ab2e-4adf-8e14-7cdb9a019bd2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17322025-01-11T05:31:46.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 07e22bbc-ab2e-4adf-8e14-7cdb9a019bd2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17332025-01-11T05:31:48.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d99d4989-92e8-4d71-a32f-25cacabdb2d6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17342025-01-11T05:31:48.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d99d4989-92e8-4d71-a32f-25cacabdb2d6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17352025-01-11T05:31:48.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d99d4989-92e8-4d71-a32f-25cacabdb2d6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17362025-01-11T05:31:49.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 25581289-31bc-45e6-80c9-943e1ca2ae9a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17372025-01-11T05:31:49.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 25581289-31bc-45e6-80c9-943e1ca2ae9a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17382025-01-11T05:31:49.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 25581289-31bc-45e6-80c9-943e1ca2ae9a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17392025-01-11T05:31:50.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cb01b6cc-311b-41eb-9a0f-af734c4a09de roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17402025-01-11T05:31:50.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cb01b6cc-311b-41eb-9a0f-af734c4a09de resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17412025-01-11T05:31:50.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cb01b6cc-311b-41eb-9a0f-af734c4a09de response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17422025-01-11T05:31:50.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
17432025-01-11T05:31:50.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
17442025-01-11T05:31:50.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17452025-01-11T05:31:50.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17462025-01-11T05:31:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17472025-01-11T05:31:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17482025-01-11T05:31:50.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17492025-01-11T05:31:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17502025-01-11T05:31:50.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17512025-01-11T05:31:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17522025-01-11T05:31:50.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17532025-01-11T05:31:50.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17542025-01-11T05:31:50.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17552025-01-11T05:31:50.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
17562025-01-11T05:31:50.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17572025-01-11T05:31:50.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17582025-01-11T05:31:50.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
17592025-01-11T05:31:50.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.401792ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
17602025-01-11T05:31:50.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17612025-01-11T05:31:50.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17622025-01-11T05:31:50.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.476715ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17632025-01-11T05:31:51.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52ee6f5f-8baa-4df8-a2a7-671b396809ef roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17642025-01-11T05:31:51.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52ee6f5f-8baa-4df8-a2a7-671b396809ef resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17652025-01-11T05:31:51.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 52ee6f5f-8baa-4df8-a2a7-671b396809ef response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17662025-01-11T05:31:52.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b8739b82-1c60-441f-9b02-408a943a2684 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17672025-01-11T05:31:52.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b8739b82-1c60-441f-9b02-408a943a2684 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17682025-01-11T05:31:52.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b8739b82-1c60-441f-9b02-408a943a2684 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17692025-01-11T05:31:53.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 06afd534-99ee-4b15-9c1f-ad7f49ebc7cd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17702025-01-11T05:31:53.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 06afd534-99ee-4b15-9c1f-ad7f49ebc7cd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17712025-01-11T05:31:53.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 06afd534-99ee-4b15-9c1f-ad7f49ebc7cd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17722025-01-11T05:31:53.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = c2afd2fe-e617-4993-a59e-90e1c1ac5d90 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
17732025-01-11T05:31:53.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = c2afd2fe-e617-4993-a59e-90e1c1ac5d90 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
17742025-01-11T05:31:53.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = c2afd2fe-e617-4993-a59e-90e1c1ac5d90 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
17752025-01-11T05:31:53.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7c5c6e6a-374c-4a2e-b7fe-116a49e89489 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
17762025-01-11T05:31:53.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7c5c6e6a-374c-4a2e-b7fe-116a49e89489 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
17772025-01-11T05:31:53.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7c5c6e6a-374c-4a2e-b7fe-116a49e89489 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
17782025-01-11T05:31:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 83106a7f-e644-4486-900b-b95716afeddb response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
17792025-01-11T05:31:54.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f88cc1f4-7200-4beb-986b-42b615c5db26 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17802025-01-11T05:31:54.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f88cc1f4-7200-4beb-986b-42b615c5db26 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17812025-01-11T05:31:54.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f88cc1f4-7200-4beb-986b-42b615c5db26 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17822025-01-11T05:31:55.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f4d2fdf6-746c-4301-8fdd-a468dd543476 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17832025-01-11T05:31:55.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f4d2fdf6-746c-4301-8fdd-a468dd543476 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17842025-01-11T05:31:55.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f4d2fdf6-746c-4301-8fdd-a468dd543476 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17852025-01-11T05:31:56.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6346ca5f-9317-4bef-ae5e-145747d2cd03 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17862025-01-11T05:31:56.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6346ca5f-9317-4bef-ae5e-145747d2cd03 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17872025-01-11T05:31:56.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6346ca5f-9317-4bef-ae5e-145747d2cd03 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17882025-01-11T05:31:57.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3a089f1-22d3-4c2f-b2eb-c259d0b23cd3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17892025-01-11T05:31:57.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3a089f1-22d3-4c2f-b2eb-c259d0b23cd3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17902025-01-11T05:31:57.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3a089f1-22d3-4c2f-b2eb-c259d0b23cd3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17912025-01-11T05:31:58.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dbc1034b-6649-4bd0-ba62-52b3ce52017c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17922025-01-11T05:31:58.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dbc1034b-6649-4bd0-ba62-52b3ce52017c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17932025-01-11T05:31:58.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dbc1034b-6649-4bd0-ba62-52b3ce52017c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17942025-01-11T05:31:59.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64b00a9c-f1c4-4e9f-8813-05b8604e1913 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17952025-01-11T05:31:59.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64b00a9c-f1c4-4e9f-8813-05b8604e1913 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17962025-01-11T05:31:59.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64b00a9c-f1c4-4e9f-8813-05b8604e1913 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17972025-01-11T05:32:00.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 630cc445-54b4-4426-a0be-38695bcba7a0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17982025-01-11T05:32:00.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 630cc445-54b4-4426-a0be-38695bcba7a0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
17992025-01-11T05:32:00.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 630cc445-54b4-4426-a0be-38695bcba7a0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18002025-01-11T05:32:00.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
18012025-01-11T05:32:00.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18022025-01-11T05:32:00.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
18032025-01-11T05:32:00.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18042025-01-11T05:32:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18052025-01-11T05:32:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18062025-01-11T05:32:00.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18072025-01-11T05:32:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18082025-01-11T05:32:00.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18092025-01-11T05:32:00.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.435375ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18102025-01-11T05:32:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18112025-01-11T05:32:00.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18122025-01-11T05:32:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18132025-01-11T05:32:00.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18142025-01-11T05:32:00.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18152025-01-11T05:32:00.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162025-01-11T05:32:00.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
18172025-01-11T05:32:00.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18182025-01-11T05:32:00.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18192025-01-11T05:32:00.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
18202025-01-11T05:32:00.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.971799ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
18212025-01-11T05:32:01.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a0d7ebb0-bae7-47ac-9a73-8b8c3983927c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18222025-01-11T05:32:01.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a0d7ebb0-bae7-47ac-9a73-8b8c3983927c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18232025-01-11T05:32:01.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a0d7ebb0-bae7-47ac-9a73-8b8c3983927c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18242025-01-11T05:32:02.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d9c42e5b-3d59-4a51-b87a-32bcfcabaed0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18252025-01-11T05:32:02.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d9c42e5b-3d59-4a51-b87a-32bcfcabaed0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18262025-01-11T05:32:02.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d9c42e5b-3d59-4a51-b87a-32bcfcabaed0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18272025-01-11T05:32:03.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 953c9e66-6b44-4d52-9f9b-6dff9a52d46b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18282025-01-11T05:32:03.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 953c9e66-6b44-4d52-9f9b-6dff9a52d46b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18292025-01-11T05:32:03.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 953c9e66-6b44-4d52-9f9b-6dff9a52d46b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18302025-01-11T05:32:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 853 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 2d3b1ecf-a5a4-4f3b-8fff-9bb49e6efd33 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
18312025-01-11T05:32:04.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b5d7ca42-de82-4701-b44c-6bbbddd90d9e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18322025-01-11T05:32:04.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b5d7ca42-de82-4701-b44c-6bbbddd90d9e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18332025-01-11T05:32:04.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b5d7ca42-de82-4701-b44c-6bbbddd90d9e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18342025-01-11T05:32:05.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9003145f-b08e-4bc3-93b1-3febade57255 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18352025-01-11T05:32:05.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9003145f-b08e-4bc3-93b1-3febade57255 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18362025-01-11T05:32:05.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9003145f-b08e-4bc3-93b1-3febade57255 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18372025-01-11T05:32:06.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 54e8c840-50fb-46fa-b0ec-37cc2e381666 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18382025-01-11T05:32:06.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 54e8c840-50fb-46fa-b0ec-37cc2e381666 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18392025-01-11T05:32:06.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 54e8c840-50fb-46fa-b0ec-37cc2e381666 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18402025-01-11T05:32:07.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 571ba019-9cdb-4564-8e1f-175b4925f3d0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18412025-01-11T05:32:07.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 571ba019-9cdb-4564-8e1f-175b4925f3d0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18422025-01-11T05:32:07.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 571ba019-9cdb-4564-8e1f-175b4925f3d0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18432025-01-11T05:32:08.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6c8149a3-011b-4406-a118-e560e79938be roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18442025-01-11T05:32:08.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6c8149a3-011b-4406-a118-e560e79938be resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18452025-01-11T05:32:08.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6c8149a3-011b-4406-a118-e560e79938be response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18462025-01-11T05:32:09.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 97b963bf-1616-469b-b612-4c2e66a3df3e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18472025-01-11T05:32:09.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 97b963bf-1616-469b-b612-4c2e66a3df3e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18482025-01-11T05:32:09.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 97b963bf-1616-469b-b612-4c2e66a3df3e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18492025-01-11T05:32:10.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3e31a55d-b721-4eba-82c0-8752f39018b8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18502025-01-11T05:32:10.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3e31a55d-b721-4eba-82c0-8752f39018b8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18512025-01-11T05:32:10.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3e31a55d-b721-4eba-82c0-8752f39018b8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
18522025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
18532025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18542025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
18552025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
18562025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18572025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18582025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
18592025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
18602025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18612025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18622025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
18632025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
18642025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18652025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
18662025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18672025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18682025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
18692025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
18702025-01-11T05:32:10.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18712025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
18722025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18732025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18742025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
18752025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18762025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18772025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
18782025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18792025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
18802025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18812025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
18822025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18832025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
18842025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18852025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18862025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18872025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18882025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
18892025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18902025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18912025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18922025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18942025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18952025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18962025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18972025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18982025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18992025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19002025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19012025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19022025-01-11T05:32:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19032025-01-11T05:32:10.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19042025-01-11T05:32:10.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19052025-01-11T05:32:10.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-01-11T05:32:10.604ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19072025-01-11T05:32:10.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19082025-01-11T05:32:10.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.134509ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19092025-01-11T05:32:10.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1470, tv_nsec: 161826741 } })
19102025-01-11T05:32:10.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112025-01-11T05:32:10.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19122025-01-11T05:32:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19132025-01-11T05:32:10.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19142025-01-11T05:32:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19152025-01-11T05:32:10.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19162025-01-11T05:32:10.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19172025-01-11T05:32:10.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19182025-01-11T05:32:10.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19192025-01-11T05:32:10.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1470, tv_nsec: 166005492 } })
19202025-01-11T05:32:10.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
19212025-01-11T05:32:10.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222025-01-11T05:32:10.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19232025-01-11T05:32:10.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19242025-01-11T05:32:10.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19252025-01-11T05:32:10.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19262025-01-11T05:32:10.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.9669ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
19272025-01-11T05:32:10.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19282025-01-11T05:32:10.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19292025-01-11T05:32:10.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.910995ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19302025-01-11T05:32:10.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19312025-01-11T05:32:10.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19322025-01-11T05:32:10.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19332025-01-11T05:32:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19342025-01-11T05:32:10.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19352025-01-11T05:32:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19362025-01-11T05:32:10.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372025-01-11T05:32:10.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
19382025-01-11T05:32:10.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19392025-01-11T05:32:10.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19402025-01-11T05:32:10.631ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
19412025-01-11T05:32:10.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.358933ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
19422025-01-11T05:32:10.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19432025-01-11T05:32:10.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19442025-01-11T05:32:10.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19452025-01-11T05:32:10.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19462025-01-11T05:32:10.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19472025-01-11T05:32:10.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19482025-01-11T05:32:10.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19492025-01-11T05:32:10.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.125501ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19502025-01-11T05:32:10.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19512025-01-11T05:32:10.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19522025-01-11T05:32:10.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19532025-01-11T05:32:10.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19542025-01-11T05:32:10.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19552025-01-11T05:32:10.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.803789ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
19562025-01-11T05:32:10.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
19572025-01-11T05:32:10.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19582025-01-11T05:32:10.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19592025-01-11T05:32:10.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19602025-01-11T05:32:10.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19612025-01-11T05:32:10.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19622025-01-11T05:32:10.648ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19632025-01-11T05:32:10.648ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19642025-01-11T05:32:10.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19652025-01-11T05:32:10.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19662025-01-11T05:32:10.649ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.588171ms iteration = 18 status = 0
19672025-01-11T05:32:10.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1470, tv_nsec: 205849095 } })
19682025-01-11T05:32:10.650ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
19692025-01-11T05:32:10.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702025-01-11T05:32:10.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19712025-01-11T05:32:10.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19722025-01-11T05:32:10.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19732025-01-11T05:32:10.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19742025-01-11T05:32:10.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19752025-01-11T05:32:10.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19762025-01-11T05:32:10.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19772025-01-11T05:32:10.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19782025-01-11T05:32:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19792025-01-11T05:32:10.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19802025-01-11T05:32:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19812025-01-11T05:32:10.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19822025-01-11T05:32:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19832025-01-11T05:32:10.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.280368ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19842025-01-11T05:32:10.683ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19852025-01-11T05:32:10.683ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19862025-01-11T05:32:10.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19872025-01-11T05:32:10.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19882025-01-11T05:32:10.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.034038ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19892025-01-11T05:32:10.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19902025-01-11T05:32:10.692ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19912025-01-11T05:32:10.692ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77127c4b-b8bd-427d-bbcc-b9de24f0931e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
19922025-01-11T05:32:10.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19932025-01-11T05:32:10.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19942025-01-11T05:32:10.703ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19952025-01-11T05:32:10.703ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.007411ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19962025-01-11T05:32:10.707ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.775315ms iteration = 20 status = {"physical_disks_added":0}
19972025-01-11T05:32:10.714ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19982025-01-11T05:32:10.714ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19992025-01-11T05:32:10.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.697517ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20002025-01-11T05:32:10.732ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
20012025-01-11T05:32:10.732ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20022025-01-11T05:32:10.732ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75a18c3c-87f0-4cd5-9506-d031a78b3e2b", "content-length": "26", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20032025-01-11T05:32:10.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20042025-01-11T05:32:10.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20052025-01-11T05:32:10.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20062025-01-11T05:32:10.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20072025-01-11T05:32:10.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082025-01-11T05:32:10.771ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20092025-01-11T05:32:10.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20102025-01-11T05:32:10.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20112025-01-11T05:32:10.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122025-01-11T05:32:10.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20132025-01-11T05:32:10.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20142025-01-11T05:32:10.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20152025-01-11T05:32:10.805ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20162025-01-11T05:32:10.806ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c5011f4-2455-4c9c-920c-730bacdf7bd2", "content-length": "1", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20172025-01-11T05:32:10.808ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20182025-01-11T05:32:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20192025-01-11T05:32:10.810ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 208.75024ms iteration = 18 status = null
20202025-01-11T05:32:10.856ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20212025-01-11T05:32:10.856ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20222025-01-11T05:32:10.857ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b60a814-b93b-4b2a-9cb5-51a92d8d95bd", "content-length": "372", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20232025-01-11T05:32:10.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20242025-01-11T05:32:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20252025-01-11T05:32:10.871ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20262025-01-11T05:32:10.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20272025-01-11T05:32:10.872ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "791822a8-9750-4298-86fe-c7ca8fd73250", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20282025-01-11T05:32:10.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20292025-01-11T05:32:10.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20302025-01-11T05:32:10.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20312025-01-11T05:32:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20322025-01-11T05:32:10.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
20332025-01-11T05:32:10.875ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20342025-01-11T05:32:10.875ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5801736-0357-4e9d-ab37-70c6a001cd33", "content-length": "26", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20352025-01-11T05:32:10.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20362025-01-11T05:32:10.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
20372025-01-11T05:32:10.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20382025-01-11T05:32:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20392025-01-11T05:32:10.886ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20402025-01-11T05:32:10.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "13ac9009-b016-4c06-be18-e6870d907575", "content-length": "691", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20412025-01-11T05:32:10.887ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20422025-01-11T05:32:10.887ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20432025-01-11T05:32:10.887ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20442025-01-11T05:32:10.888ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 286.130464ms iteration = 18 status = {}
20452025-01-11T05:32:10.890ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20462025-01-11T05:32:10.890ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20472025-01-11T05:32:10.890ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3187e5a-0cce-43e2-9d2c-aea9e7ff034d", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20482025-01-11T05:32:10.892ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 289.968068ms iteration = 18 status = {}
20492025-01-11T05:32:10.903ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 301.560321ms iteration = 18 status = {}
20502025-01-11T05:32:10.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20512025-01-11T05:32:10.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20522025-01-11T05:32:10.982ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
20532025-01-11T05:32:10.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20542025-01-11T05:32:10.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20552025-01-11T05:32:10.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20562025-01-11T05:32:10.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "57acaa71-e05c-4eab-98f1-09ecf27396ae", "content-length": "134", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20572025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20582025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
20592025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20602025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20612025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20622025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20632025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20642025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20652025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20662025-01-11T05:32:10.989ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20672025-01-11T05:32:10.990ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
20682025-01-11T05:32:10.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20692025-01-11T05:32:10.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20702025-01-11T05:32:10.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20712025-01-11T05:32:10.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0389d5ea-ed53-40b6-90b6-ba1d91631289", "content-length": "2", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20722025-01-11T05:32:10.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20732025-01-11T05:32:10.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fec97de9-5e4e-49c1-9700-9636577c203b", "content-length": "52", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20742025-01-11T05:32:10.992ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
20752025-01-11T05:32:10.992ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20762025-01-11T05:32:11.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d42e05c2-0921-4bd0-8a09-3367d8d10a6e", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20772025-01-11T05:32:11.092ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
20782025-01-11T05:32:11.092ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20792025-01-11T05:32:11.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "999b9b33-30e4-4300-ba05-f75a6f80161b", "content-length": "682", "date": "Sat, 11 Jan 2025 05:32:10 GMT"} })
20802025-01-11T05:32:11.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20812025-01-11T05:32:11.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20822025-01-11T05:32:11.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20832025-01-11T05:32:11.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20842025-01-11T05:32:11.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20852025-01-11T05:32:11.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20862025-01-11T05:32:11.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20872025-01-11T05:32:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20882025-01-11T05:32:11.107ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 505.711091ms iteration = 18 status = {}
20892025-01-11T05:32:11.489ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20902025-01-11T05:32:11.489ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
20912025-01-11T05:32:11.520ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
20922025-01-11T05:32:11.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 92f5d844-25b2-46eb-a222-91c63b0ee0da roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
20932025-01-11T05:32:11.520ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:33766
20942025-01-11T05:32:11.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33766 req_id = 8dd6cb50-9dcc-48fe-b281-c4eaf6529fe9 roles = RoleSet { roles: {} } uri = /metrics/producers
20952025-01-11T05:32:11.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 92f5d844-25b2-46eb-a222-91c63b0ee0da resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
20962025-01-11T05:32:11.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33766 req_id = 8dd6cb50-9dcc-48fe-b281-c4eaf6529fe9 resource = Database result = Ok(()) uri = /metrics/producers
20972025-01-11T05:32:11.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 92f5d844-25b2-46eb-a222-91c63b0ee0da response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
20982025-01-11T05:32:11.560ZINFOnexus: assigned collector to new producer collector_id = 68ba0762-4eeb-4568-8923-69d504e34a00 file = nexus/src/app/oximeter.rs:76 producer_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
20992025-01-11T05:32:11.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39788 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33766 req_id = 8dd6cb50-9dcc-48fe-b281-c4eaf6529fe9 response_code = 201 uri = /metrics/producers
21002025-01-11T05:32:11.560ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8dd6cb50-9dcc-48fe-b281-c4eaf6529fe9", "content-length": "41", "date": "Sat, 11 Jan 2025 05:32:11 GMT"} })
21012025-01-11T05:32:11.561ZDEBGnexus (producer-registration-task): registered with nexus successfully
21022025-01-11T05:32:11.561ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21032025-01-11T05:32:11.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 3283c45a-9044-46ed-a4de-7fdb7a8d35f4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21042025-01-11T05:32:11.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 3283c45a-9044-46ed-a4de-7fdb7a8d35f4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21052025-01-11T05:32:11.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 3283c45a-9044-46ed-a4de-7fdb7a8d35f4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21062025-01-11T05:32:12.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f01b7bc-9135-4cdb-b73f-c9ec7c86b408 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21072025-01-11T05:32:12.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f01b7bc-9135-4cdb-b73f-c9ec7c86b408 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21082025-01-11T05:32:12.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f01b7bc-9135-4cdb-b73f-c9ec7c86b408 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21092025-01-11T05:32:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 14db3213-aa69-4cd7-862e-f9c5ab54832b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21102025-01-11T05:32:13.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 14db3213-aa69-4cd7-862e-f9c5ab54832b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21112025-01-11T05:32:13.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 14db3213-aa69-4cd7-862e-f9c5ab54832b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21122025-01-11T05:32:13.784ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 632 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 5e766261-fc75-4c0a-83b6-561f2f4789b5 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
21132025-01-11T05:32:14.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1a8a9526-19cd-4380-9094-a0d15a5b3ab7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21142025-01-11T05:32:14.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1a8a9526-19cd-4380-9094-a0d15a5b3ab7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21152025-01-11T05:32:14.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1a8a9526-19cd-4380-9094-a0d15a5b3ab7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21162025-01-11T05:32:15.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = df0e019b-d7f6-4aec-9076-5a633f0a080e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21172025-01-11T05:32:15.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = df0e019b-d7f6-4aec-9076-5a633f0a080e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21182025-01-11T05:32:15.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = df0e019b-d7f6-4aec-9076-5a633f0a080e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21192025-01-11T05:32:16.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 21d300a6-8315-4d5f-8c7e-6930adef07cb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21202025-01-11T05:32:16.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 21d300a6-8315-4d5f-8c7e-6930adef07cb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21212025-01-11T05:32:16.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 21d300a6-8315-4d5f-8c7e-6930adef07cb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21222025-01-11T05:32:17.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0489aefc-fac0-42f5-af75-e8e0d8bbb9bc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21232025-01-11T05:32:17.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0489aefc-fac0-42f5-af75-e8e0d8bbb9bc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21242025-01-11T05:32:17.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0489aefc-fac0-42f5-af75-e8e0d8bbb9bc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21252025-01-11T05:32:18.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a2543482-1764-4c95-8836-fdf5cfa5a69a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21262025-01-11T05:32:18.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a2543482-1764-4c95-8836-fdf5cfa5a69a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21272025-01-11T05:32:18.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a2543482-1764-4c95-8836-fdf5cfa5a69a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21282025-01-11T05:32:19.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e8941368-ad6d-466e-b933-d5fd5f79c82f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21292025-01-11T05:32:19.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e8941368-ad6d-466e-b933-d5fd5f79c82f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21302025-01-11T05:32:19.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e8941368-ad6d-466e-b933-d5fd5f79c82f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21312025-01-11T05:32:20.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
21322025-01-11T05:32:20.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
21332025-01-11T05:32:20.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21342025-01-11T05:32:20.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21352025-01-11T05:32:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21362025-01-11T05:32:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21372025-01-11T05:32:20.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382025-01-11T05:32:20.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21392025-01-11T05:32:20.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21402025-01-11T05:32:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21412025-01-11T05:32:20.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21422025-01-11T05:32:20.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21432025-01-11T05:32:20.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21442025-01-11T05:32:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
21452025-01-11T05:32:20.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21462025-01-11T05:32:20.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21472025-01-11T05:32:20.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
21482025-01-11T05:32:20.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.706845ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
21492025-01-11T05:32:20.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21502025-01-11T05:32:20.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21512025-01-11T05:32:20.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.844077ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21522025-01-11T05:32:20.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 623ab09d-44d4-463a-9850-37ee9d34f380 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21532025-01-11T05:32:20.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 623ab09d-44d4-463a-9850-37ee9d34f380 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21542025-01-11T05:32:20.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 623ab09d-44d4-463a-9850-37ee9d34f380 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21552025-01-11T05:32:21.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d1ff6f84-efef-49ad-8e7d-376bde6814e9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21562025-01-11T05:32:21.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d1ff6f84-efef-49ad-8e7d-376bde6814e9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21572025-01-11T05:32:21.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d1ff6f84-efef-49ad-8e7d-376bde6814e9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21582025-01-11T05:32:22.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5f7520fb-f438-43ca-8546-09a83dcece0d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21592025-01-11T05:32:22.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5f7520fb-f438-43ca-8546-09a83dcece0d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21602025-01-11T05:32:22.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5f7520fb-f438-43ca-8546-09a83dcece0d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21612025-01-11T05:32:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 620 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = e94b22c8-95d0-433e-b5a5-260a8690b5da response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
21622025-01-11T05:32:23.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 09be17c6-bc34-4b3a-b87f-675bf688e2cb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21632025-01-11T05:32:23.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 09be17c6-bc34-4b3a-b87f-675bf688e2cb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21642025-01-11T05:32:23.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 09be17c6-bc34-4b3a-b87f-675bf688e2cb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21652025-01-11T05:32:24.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08676470-905f-4a6e-821b-38a8cb0d225c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21662025-01-11T05:32:24.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08676470-905f-4a6e-821b-38a8cb0d225c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21672025-01-11T05:32:24.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08676470-905f-4a6e-821b-38a8cb0d225c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21682025-01-11T05:32:25.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = be0474a7-3f81-49c9-b962-6c88845e5bbe roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21692025-01-11T05:32:25.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = be0474a7-3f81-49c9-b962-6c88845e5bbe resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21702025-01-11T05:32:25.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = be0474a7-3f81-49c9-b962-6c88845e5bbe response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21712025-01-11T05:32:26.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3a1684c5-8005-4ac1-9e2d-78784d6e8b97 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21722025-01-11T05:32:26.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3a1684c5-8005-4ac1-9e2d-78784d6e8b97 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21732025-01-11T05:32:26.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3a1684c5-8005-4ac1-9e2d-78784d6e8b97 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21742025-01-11T05:32:27.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e6b4e04e-b413-407e-bb39-0ceb2c2f1f64 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21752025-01-11T05:32:27.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e6b4e04e-b413-407e-bb39-0ceb2c2f1f64 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21762025-01-11T05:32:27.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e6b4e04e-b413-407e-bb39-0ceb2c2f1f64 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21772025-01-11T05:32:28.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 11822644-1d38-4f15-9599-1bd55c726b02 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21782025-01-11T05:32:28.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 11822644-1d38-4f15-9599-1bd55c726b02 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21792025-01-11T05:32:28.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 11822644-1d38-4f15-9599-1bd55c726b02 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21802025-01-11T05:32:29.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0452a709-37b8-4543-9795-647241557573 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21812025-01-11T05:32:29.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0452a709-37b8-4543-9795-647241557573 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21822025-01-11T05:32:29.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0452a709-37b8-4543-9795-647241557573 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
21832025-01-11T05:32:30.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
21842025-01-11T05:32:30.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
21852025-01-11T05:32:30.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21862025-01-11T05:32:30.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21872025-01-11T05:32:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21882025-01-11T05:32:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21892025-01-11T05:32:30.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21902025-01-11T05:32:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21912025-01-11T05:32:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21922025-01-11T05:32:30.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21932025-01-11T05:32:30.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21942025-01-11T05:32:30.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21952025-01-11T05:32:30.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21962025-01-11T05:32:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21972025-01-11T05:32:30.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21982025-01-11T05:32:30.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
21992025-01-11T05:32:30.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22002025-01-11T05:32:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22012025-01-11T05:32:30.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
22022025-01-11T05:32:30.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.100286ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
22032025-01-11T05:32:30.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.749453ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22042025-01-11T05:32:30.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f65b7d3-eb09-442a-b173-7dcc2ed87f17 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22052025-01-11T05:32:30.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f65b7d3-eb09-442a-b173-7dcc2ed87f17 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22062025-01-11T05:32:30.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f65b7d3-eb09-442a-b173-7dcc2ed87f17 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22072025-01-11T05:32:31.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f077f90-f8d2-4742-939c-270830f0be7b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22082025-01-11T05:32:31.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f077f90-f8d2-4742-939c-270830f0be7b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22092025-01-11T05:32:31.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f077f90-f8d2-4742-939c-270830f0be7b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22102025-01-11T05:32:32.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f902e26e-1f8d-45a4-9aca-5db34d77cc41 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22112025-01-11T05:32:32.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f902e26e-1f8d-45a4-9aca-5db34d77cc41 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22122025-01-11T05:32:32.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f902e26e-1f8d-45a4-9aca-5db34d77cc41 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22132025-01-11T05:32:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 537 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = f9693d05-c700-47f5-84a9-6d919522eb39 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
22142025-01-11T05:32:34.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 678718cb-bb75-4105-b693-37f6e0892bff roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22152025-01-11T05:32:34.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 678718cb-bb75-4105-b693-37f6e0892bff resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22162025-01-11T05:32:34.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 678718cb-bb75-4105-b693-37f6e0892bff response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22172025-01-11T05:32:35.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73a1116c-4810-46f1-a053-30dbb3e26129 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22182025-01-11T05:32:35.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73a1116c-4810-46f1-a053-30dbb3e26129 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22192025-01-11T05:32:35.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73a1116c-4810-46f1-a053-30dbb3e26129 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22202025-01-11T05:32:36.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 217989d9-556c-4646-ae52-2726b6a83184 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22212025-01-11T05:32:36.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 217989d9-556c-4646-ae52-2726b6a83184 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22222025-01-11T05:32:36.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 217989d9-556c-4646-ae52-2726b6a83184 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22232025-01-11T05:32:37.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4f7ca23-32c9-43b1-a6b1-9900b710529b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22242025-01-11T05:32:37.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4f7ca23-32c9-43b1-a6b1-9900b710529b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22252025-01-11T05:32:37.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4f7ca23-32c9-43b1-a6b1-9900b710529b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22262025-01-11T05:32:38.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 68d934ab-9447-4a26-b34f-e5895c27525e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22272025-01-11T05:32:38.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 68d934ab-9447-4a26-b34f-e5895c27525e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22282025-01-11T05:32:38.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 68d934ab-9447-4a26-b34f-e5895c27525e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22292025-01-11T05:32:39.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f4df6f4-5f70-45dd-b397-040927d778e2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22302025-01-11T05:32:39.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f4df6f4-5f70-45dd-b397-040927d778e2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22312025-01-11T05:32:39.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f4df6f4-5f70-45dd-b397-040927d778e2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22322025-01-11T05:32:40.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 63c6c28b-829c-424b-92e3-c5b83fe02a6b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22332025-01-11T05:32:40.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 63c6c28b-829c-424b-92e3-c5b83fe02a6b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22342025-01-11T05:32:40.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 63c6c28b-829c-424b-92e3-c5b83fe02a6b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
22352025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
22362025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
22372025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22382025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
22392025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22402025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
22412025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
22422025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22432025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
22442025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22452025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22462025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22472025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
22482025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
22492025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22502025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22512025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
22522025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22532025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
22542025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22552025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
22562025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22572025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
22582025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22592025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
22602025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
22612025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22622025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22632025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22642025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
22652025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22662025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
22672025-01-11T05:32:40.601ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:22:40.601706253 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22682025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
22692025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22702025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
22712025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22722025-01-11T05:32:40.601ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22732025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22742025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
22752025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22762025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
22772025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22782025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
22792025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22802025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
22812025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
22822025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
22832025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22842025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
22852025-01-11T05:32:40.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22862025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22872025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
22882025-01-11T05:32:40.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22892025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
22902025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
22912025-01-11T05:32:40.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
22922025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.01\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
22932025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
22942025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22952025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
22962025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22972025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22982025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22992025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23002025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23012025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23022025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23032025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23042025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23052025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23062025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23072025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23082025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23092025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23102025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23112025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23122025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23132025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23142025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23152025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
23162025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23172025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23182025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23192025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23202025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23212025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23222025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23232025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23242025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23252025-01-11T05:32:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 158601614 } })
23262025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23272025-01-11T05:32:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 158662245 } })
23282025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23292025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23302025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23312025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23322025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23332025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23342025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.134555ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23352025-01-11T05:32:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23362025-01-11T05:32:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
23372025-01-11T05:32:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.199746ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
23382025-01-11T05:32:40.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23392025-01-11T05:32:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23402025-01-11T05:32:40.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23412025-01-11T05:32:40.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23422025-01-11T05:32:40.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.491666ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
23432025-01-11T05:32:40.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.782282ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23442025-01-11T05:32:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23452025-01-11T05:32:40.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23462025-01-11T05:32:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23472025-01-11T05:32:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23482025-01-11T05:32:40.606ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23492025-01-11T05:32:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23502025-01-11T05:32:40.608ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.026374ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
23512025-01-11T05:32:40.609ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23522025-01-11T05:32:40.609ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23532025-01-11T05:32:40.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23542025-01-11T05:32:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23552025-01-11T05:32:40.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23562025-01-11T05:32:40.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23572025-01-11T05:32:40.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 166674780 } })
23582025-01-11T05:32:40.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23592025-01-11T05:32:40.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23602025-01-11T05:32:40.611ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23612025-01-11T05:32:40.611ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23622025-01-11T05:32:40.611ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.915987ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23632025-01-11T05:32:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23642025-01-11T05:32:40.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23652025-01-11T05:32:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23662025-01-11T05:32:40.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672025-01-11T05:32:40.616ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:22:40.601706253 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23682025-01-11T05:32:40.616ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.09061ms iteration = 10 status = {"expiration":"2025-01-11T05:22:40.601706253Z","pruned":[]}
23692025-01-11T05:32:40.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702025-01-11T05:32:40.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23712025-01-11T05:32:40.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23722025-01-11T05:32:40.617ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 173802156 } })
23732025-01-11T05:32:40.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23742025-01-11T05:32:40.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23752025-01-11T05:32:40.619ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23762025-01-11T05:32:40.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23772025-01-11T05:32:40.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23782025-01-11T05:32:40.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23792025-01-11T05:32:40.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23802025-01-11T05:32:40.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812025-01-11T05:32:40.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23822025-01-11T05:32:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23832025-01-11T05:32:40.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23842025-01-11T05:32:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23852025-01-11T05:32:40.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862025-01-11T05:32:40.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23872025-01-11T05:32:40.631ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1500, tv_nsec: 187932926 } })
23882025-01-11T05:32:40.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23892025-01-11T05:32:40.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23902025-01-11T05:32:40.632ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
23912025-01-11T05:32:40.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23922025-01-11T05:32:40.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23932025-01-11T05:32:40.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23942025-01-11T05:32:40.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952025-01-11T05:32:40.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23962025-01-11T05:32:40.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23972025-01-11T05:32:40.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23982025-01-11T05:32:40.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23992025-01-11T05:32:40.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24002025-01-11T05:32:40.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24012025-01-11T05:32:40.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24022025-01-11T05:32:40.650ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24032025-01-11T05:32:40.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24042025-01-11T05:32:40.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24052025-01-11T05:32:40.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.295097ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24062025-01-11T05:32:40.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24072025-01-11T05:32:40.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24082025-01-11T05:32:40.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24092025-01-11T05:32:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24102025-01-11T05:32:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24112025-01-11T05:32:40.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.04088ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24122025-01-11T05:32:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
24132025-01-11T05:32:40.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24142025-01-11T05:32:40.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24152025-01-11T05:32:40.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24162025-01-11T05:32:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24172025-01-11T05:32:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24182025-01-11T05:32:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24192025-01-11T05:32:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24202025-01-11T05:32:40.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24212025-01-11T05:32:40.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24222025-01-11T05:32:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24232025-01-11T05:32:40.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24242025-01-11T05:32:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24252025-01-11T05:32:40.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24262025-01-11T05:32:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24272025-01-11T05:32:40.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.34938ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
24282025-01-11T05:32:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24292025-01-11T05:32:40.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24302025-01-11T05:32:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24312025-01-11T05:32:40.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24322025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24332025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24342025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
24352025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.618683ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
24362025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24372025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24382025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24392025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24402025-01-11T05:32:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24412025-01-11T05:32:40.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24422025-01-11T05:32:40.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24432025-01-11T05:32:40.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24452025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24462025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24472025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24482025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24492025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24502025-01-11T05:32:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24512025-01-11T05:32:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24522025-01-11T05:32:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24532025-01-11T05:32:40.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24542025-01-11T05:32:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24552025-01-11T05:32:40.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24562025-01-11T05:32:40.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24572025-01-11T05:32:40.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24582025-01-11T05:32:40.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592025-01-11T05:32:40.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24602025-01-11T05:32:40.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24612025-01-11T05:32:40.685ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24622025-01-11T05:32:40.685ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24632025-01-11T05:32:40.685ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24642025-01-11T05:32:40.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24652025-01-11T05:32:40.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662025-01-11T05:32:40.686ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.275426ms iteration = 5 status = {"nsuccess":5}
24672025-01-11T05:32:40.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24682025-01-11T05:32:40.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24692025-01-11T05:32:40.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24702025-01-11T05:32:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24712025-01-11T05:32:40.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24722025-01-11T05:32:40.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24732025-01-11T05:32:40.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24742025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24752025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24762025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24772025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24782025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24792025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24802025-01-11T05:32:40.691ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24812025-01-11T05:32:40.691ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.924758ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24822025-01-11T05:32:40.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.904609ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24832025-01-11T05:32:40.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.504946ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24842025-01-11T05:32:40.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24852025-01-11T05:32:40.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24862025-01-11T05:32:40.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24872025-01-11T05:32:40.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24882025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24892025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24902025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24912025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24922025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24932025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24942025-01-11T05:32:40.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952025-01-11T05:32:40.723ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24962025-01-11T05:32:40.723ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
24972025-01-11T05:32:40.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24982025-01-11T05:32:40.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24992025-01-11T05:32:40.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25002025-01-11T05:32:40.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25012025-01-11T05:32:40.724ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25022025-01-11T05:32:40.724ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25032025-01-11T05:32:40.724ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.825969ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25042025-01-11T05:32:40.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
25052025-01-11T05:32:40.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25062025-01-11T05:32:40.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25072025-01-11T05:32:40.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25082025-01-11T05:32:40.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25092025-01-11T05:32:40.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25102025-01-11T05:32:40.728ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 126.95978ms iteration = 19 status = 0
25112025-01-11T05:32:40.730ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25122025-01-11T05:32:40.730ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 128.638436ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25132025-01-11T05:32:40.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25142025-01-11T05:32:40.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25152025-01-11T05:32:40.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25162025-01-11T05:32:40.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25172025-01-11T05:32:40.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25182025-01-11T05:32:40.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25192025-01-11T05:32:40.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25202025-01-11T05:32:40.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25212025-01-11T05:32:40.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25222025-01-11T05:32:40.735ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25232025-01-11T05:32:40.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25242025-01-11T05:32:40.737ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25252025-01-11T05:32:40.738ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc992078-e762-4051-9ee7-3ce103455785", "content-length": "26", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
25262025-01-11T05:32:40.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25272025-01-11T05:32:40.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25282025-01-11T05:32:40.759ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25292025-01-11T05:32:40.759ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 158.218554ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25302025-01-11T05:32:40.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312025-01-11T05:32:40.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25322025-01-11T05:32:40.764ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25332025-01-11T05:32:40.764ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6457d9bc-36cd-44b5-9462-0a01ff4a803b", "content-length": "26", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
25342025-01-11T05:32:40.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25352025-01-11T05:32:40.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25362025-01-11T05:32:40.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25372025-01-11T05:32:40.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25382025-01-11T05:32:40.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25392025-01-11T05:32:40.768ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
25402025-01-11T05:32:40.768ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25412025-01-11T05:32:40.768ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
25422025-01-11T05:32:40.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 166.468144ms iteration = 10 status = {"generation":2}
25432025-01-11T05:32:40.772ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
25442025-01-11T05:32:40.772ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25452025-01-11T05:32:40.772ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f11a1903-4988-474a-ae6e-476647e2497f", "content-length": "26", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
25462025-01-11T05:32:40.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25472025-01-11T05:32:40.773ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25482025-01-11T05:32:40.773ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25492025-01-11T05:32:40.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25502025-01-11T05:32:40.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25512025-01-11T05:32:40.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
25522025-01-11T05:32:40.778ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
25532025-01-11T05:32:40.778ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 177.339042ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25542025-01-11T05:32:40.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552025-01-11T05:32:40.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25562025-01-11T05:32:40.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25572025-01-11T05:32:40.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25582025-01-11T05:32:40.786ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25592025-01-11T05:32:40.786ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25602025-01-11T05:32:40.786ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
25612025-01-11T05:32:40.786ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 184.150741ms iteration = 10 status = {"generation":1}
25622025-01-11T05:32:40.798ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.482181ms iteration = 21 status = {"physical_disks_added":0}
25632025-01-11T05:32:40.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25642025-01-11T05:32:40.984ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.038545ms iteration = 19 status = {}
25652025-01-11T05:32:41.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25662025-01-11T05:32:41.056ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ebbbe20-82dd-43af-8fbd-c30a3f5d6feb", "content-length": "691", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} })
25672025-01-11T05:32:41.056ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25682025-01-11T05:32:41.056ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25692025-01-11T05:32:41.056ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25702025-01-11T05:32:41.057ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.031273ms iteration = 19 status = {}
25712025-01-11T05:32:41.061ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25722025-01-11T05:32:41.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ae286c3e-18ca-4fee-b2d5-e59199fa1d49", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25732025-01-11T05:32:41.062ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25742025-01-11T05:32:41.063ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aab3b3e7-9736-4a00-b61c-5fdee1e91d9a", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25752025-01-11T05:32:41.063ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25762025-01-11T05:32:41.065ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25772025-01-11T05:32:41.065ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 463.360314ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25782025-01-11T05:32:41.071ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25792025-01-11T05:32:41.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25802025-01-11T05:32:41.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0c5728c-1530-4635-8b60-822adb1993e3", "content-length": "372", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} })
25812025-01-11T05:32:41.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25822025-01-11T05:32:41.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25832025-01-11T05:32:41.105ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25842025-01-11T05:32:41.105ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "89592cc8-15bf-47f9-9e44-c4bc224a8a5a", "content-length": "1", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
25852025-01-11T05:32:41.107ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25862025-01-11T05:32:41.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25872025-01-11T05:32:41.110ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 508.645235ms iteration = 19 status = null
25882025-01-11T05:32:41.112ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25892025-01-11T05:32:41.112ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25902025-01-11T05:32:41.112ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "30bb58e0-c756-42a4-b6fb-4518c5727f8c", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} })
25912025-01-11T05:32:41.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25922025-01-11T05:32:41.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25932025-01-11T05:32:41.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25942025-01-11T05:32:41.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25952025-01-11T05:32:41.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25962025-01-11T05:32:41.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25972025-01-11T05:32:41.120ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25982025-01-11T05:32:41.120ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25992025-01-11T05:32:41.121ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "56cfb1c0-1d16-47a3-af65-52bf5f3a329f", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} })
26002025-01-11T05:32:41.123ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 521.586398ms iteration = 19 status = {}
26012025-01-11T05:32:41.133ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26022025-01-11T05:32:41.133ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f88a6749-25d4-473f-b87b-cab1f89b264d", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26032025-01-11T05:32:41.133ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26042025-01-11T05:32:41.134ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4262f759-80e2-4bc0-a615-4ea7893bb7a6", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26052025-01-11T05:32:41.134ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26062025-01-11T05:32:41.136ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b044c320-870c-4d80-8d50-4708f2678a0d", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26072025-01-11T05:32:41.136ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26082025-01-11T05:32:41.138ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26092025-01-11T05:32:41.138ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 536.273069ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26102025-01-11T05:32:41.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26112025-01-11T05:32:41.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26122025-01-11T05:32:41.160ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
26132025-01-11T05:32:41.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26142025-01-11T05:32:41.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26152025-01-11T05:32:41.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e0328598-65fd-4d74-8d05-cf141cdc97b6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26162025-01-11T05:32:41.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e0328598-65fd-4d74-8d05-cf141cdc97b6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26172025-01-11T05:32:41.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26182025-01-11T05:32:41.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9033678-2e90-4de6-9906-b29b51c7e946", "content-length": "134", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
26192025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26202025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
26212025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26222025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26232025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26242025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26252025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26262025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26272025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26282025-01-11T05:32:41.169ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26292025-01-11T05:32:41.170ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
26302025-01-11T05:32:41.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26312025-01-11T05:32:41.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26322025-01-11T05:32:41.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e0328598-65fd-4d74-8d05-cf141cdc97b6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26332025-01-11T05:32:41.172ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26342025-01-11T05:32:41.172ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c11cf45-6b3d-4016-ab0b-da3e88a60de4", "content-length": "2", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
26352025-01-11T05:32:41.172ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26362025-01-11T05:32:41.172ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4262b2c8-5c83-4243-bd5d-b65d62756bef", "content-length": "52", "date": "Sat, 11 Jan 2025 05:32:40 GMT"} })
26372025-01-11T05:32:41.172ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
26382025-01-11T05:32:41.172ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26392025-01-11T05:32:41.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6f2d0512-f0ba-4348-879a-f24f4ac35643", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} })
26402025-01-11T05:32:41.269ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
26412025-01-11T05:32:41.269ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26422025-01-11T05:32:41.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c2ac1e2-1ef7-444b-a20a-b10c5e4d0050", "content-length": "682", "date": "Sat, 11 Jan 2025 05:32:41 GMT"} })
26432025-01-11T05:32:41.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26442025-01-11T05:32:41.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26452025-01-11T05:32:41.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26462025-01-11T05:32:41.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26472025-01-11T05:32:41.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26482025-01-11T05:32:41.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26492025-01-11T05:32:41.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26502025-01-11T05:32:41.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26512025-01-11T05:32:41.286ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 685.334373ms iteration = 19 status = {}
26522025-01-11T05:32:41.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 6f233eab-c36c-436e-b0cd-27287f3780a8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26532025-01-11T05:32:41.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 6f233eab-c36c-436e-b0cd-27287f3780a8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26542025-01-11T05:32:41.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 6f233eab-c36c-436e-b0cd-27287f3780a8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26552025-01-11T05:32:42.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee28f7cf-32ab-4569-ab5c-27c462006a33 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26562025-01-11T05:32:42.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee28f7cf-32ab-4569-ab5c-27c462006a33 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26572025-01-11T05:32:42.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee28f7cf-32ab-4569-ab5c-27c462006a33 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26582025-01-11T05:32:43.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4a4983b-ddbd-4072-a331-b36db9b4968a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26592025-01-11T05:32:43.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4a4983b-ddbd-4072-a331-b36db9b4968a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26602025-01-11T05:32:43.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b4a4983b-ddbd-4072-a331-b36db9b4968a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26612025-01-11T05:32:43.784ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 856 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 2e229b4f-3036-4b3d-9f9c-269b1439fdc7 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
26622025-01-11T05:32:44.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 167140a7-3139-4f31-9009-c630f4b87acb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26632025-01-11T05:32:44.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 167140a7-3139-4f31-9009-c630f4b87acb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26642025-01-11T05:32:44.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 167140a7-3139-4f31-9009-c630f4b87acb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26652025-01-11T05:32:45.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8a7c2fc2-7515-4172-ad07-9108b9208f2f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26662025-01-11T05:32:45.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8a7c2fc2-7515-4172-ad07-9108b9208f2f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26672025-01-11T05:32:45.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8a7c2fc2-7515-4172-ad07-9108b9208f2f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26682025-01-11T05:32:46.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0d8f65af-798c-476f-8ee2-909fddbd18b3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26692025-01-11T05:32:46.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0d8f65af-798c-476f-8ee2-909fddbd18b3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26702025-01-11T05:32:46.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0d8f65af-798c-476f-8ee2-909fddbd18b3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26712025-01-11T05:32:47.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9c0f53c1-926d-4b76-b3ac-4a14a78accf6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26722025-01-11T05:32:47.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9c0f53c1-926d-4b76-b3ac-4a14a78accf6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26732025-01-11T05:32:47.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9c0f53c1-926d-4b76-b3ac-4a14a78accf6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26742025-01-11T05:32:48.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cffdf34d-eb58-4866-8b55-884b946f8d48 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26752025-01-11T05:32:48.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cffdf34d-eb58-4866-8b55-884b946f8d48 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26762025-01-11T05:32:48.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cffdf34d-eb58-4866-8b55-884b946f8d48 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26772025-01-11T05:32:49.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2ce0d32b-357f-4f55-bcd9-d8e1eaec6cce roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26782025-01-11T05:32:49.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2ce0d32b-357f-4f55-bcd9-d8e1eaec6cce resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26792025-01-11T05:32:49.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2ce0d32b-357f-4f55-bcd9-d8e1eaec6cce response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26802025-01-11T05:32:50.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8d1b2d34-fa67-4b46-ab30-ee1e8fedd88e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26812025-01-11T05:32:50.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8d1b2d34-fa67-4b46-ab30-ee1e8fedd88e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26822025-01-11T05:32:50.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8d1b2d34-fa67-4b46-ab30-ee1e8fedd88e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
26832025-01-11T05:32:50.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
26842025-01-11T05:32:50.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
26852025-01-11T05:32:50.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26862025-01-11T05:32:50.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26872025-01-11T05:32:50.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26882025-01-11T05:32:50.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26892025-01-11T05:32:50.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26902025-01-11T05:32:50.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26912025-01-11T05:32:50.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26922025-01-11T05:32:50.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26932025-01-11T05:32:50.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26942025-01-11T05:32:50.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26952025-01-11T05:32:50.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26962025-01-11T05:32:50.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26972025-01-11T05:32:50.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26982025-01-11T05:32:50.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
26992025-01-11T05:32:50.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27002025-01-11T05:32:50.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27012025-01-11T05:32:50.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
27022025-01-11T05:32:50.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.439382ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
27032025-01-11T05:32:50.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.486391ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27042025-01-11T05:32:51.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 31504f57-bde3-4788-abc7-63a1f9f6c70e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27052025-01-11T05:32:51.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 31504f57-bde3-4788-abc7-63a1f9f6c70e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27062025-01-11T05:32:51.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 31504f57-bde3-4788-abc7-63a1f9f6c70e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27072025-01-11T05:32:52.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7409bc39-8d01-441d-a550-edbd82016ce5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27082025-01-11T05:32:52.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7409bc39-8d01-441d-a550-edbd82016ce5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27092025-01-11T05:32:52.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7409bc39-8d01-441d-a550-edbd82016ce5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27102025-01-11T05:32:53.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c39ea657-fce0-400f-baa5-6a12c478c713 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27112025-01-11T05:32:53.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c39ea657-fce0-400f-baa5-6a12c478c713 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27122025-01-11T05:32:53.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c39ea657-fce0-400f-baa5-6a12c478c713 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27132025-01-11T05:32:53.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = a34c24ec-8c5f-4bf9-b27b-89be4ee1478d roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
27142025-01-11T05:32:53.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = a34c24ec-8c5f-4bf9-b27b-89be4ee1478d resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
27152025-01-11T05:32:53.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = a34c24ec-8c5f-4bf9-b27b-89be4ee1478d response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
27162025-01-11T05:32:53.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7941f90e-8197-4277-aecc-71420249ce74 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
27172025-01-11T05:32:53.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7941f90e-8197-4277-aecc-71420249ce74 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
27182025-01-11T05:32:53.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7941f90e-8197-4277-aecc-71420249ce74 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
27192025-01-11T05:32:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 589 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 923ceefe-bfc7-452c-8ec5-92ecdd606b89 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
27202025-01-11T05:32:54.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b05cd6de-c2c4-40bf-ac7d-6a7f62d142d8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27212025-01-11T05:32:54.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b05cd6de-c2c4-40bf-ac7d-6a7f62d142d8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27222025-01-11T05:32:54.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b05cd6de-c2c4-40bf-ac7d-6a7f62d142d8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27232025-01-11T05:32:55.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 678427eb-abdd-4e21-93f8-3b1af22b6bf2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27242025-01-11T05:32:55.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 678427eb-abdd-4e21-93f8-3b1af22b6bf2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27252025-01-11T05:32:55.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 678427eb-abdd-4e21-93f8-3b1af22b6bf2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27262025-01-11T05:32:56.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08e1e17c-5502-44fd-916f-619053601361 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27272025-01-11T05:32:56.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08e1e17c-5502-44fd-916f-619053601361 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27282025-01-11T05:32:56.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08e1e17c-5502-44fd-916f-619053601361 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27292025-01-11T05:32:57.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c7ede012-1455-45d5-8d8b-d7584457557e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27302025-01-11T05:32:57.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c7ede012-1455-45d5-8d8b-d7584457557e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27312025-01-11T05:32:57.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c7ede012-1455-45d5-8d8b-d7584457557e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27322025-01-11T05:32:58.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 988183c0-7339-4451-87ba-8927a1b3a0f2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27332025-01-11T05:32:58.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 988183c0-7339-4451-87ba-8927a1b3a0f2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27342025-01-11T05:32:58.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 988183c0-7339-4451-87ba-8927a1b3a0f2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27352025-01-11T05:32:59.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c4f17e55-9b99-4beb-be54-0035d953cf30 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27362025-01-11T05:32:59.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c4f17e55-9b99-4beb-be54-0035d953cf30 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27372025-01-11T05:32:59.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c4f17e55-9b99-4beb-be54-0035d953cf30 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27382025-01-11T05:33:00.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
27392025-01-11T05:33:00.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
27402025-01-11T05:33:00.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27412025-01-11T05:33:00.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27422025-01-11T05:33:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27432025-01-11T05:33:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27442025-01-11T05:33:00.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452025-01-11T05:33:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27462025-01-11T05:33:00.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27472025-01-11T05:33:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27482025-01-11T05:33:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27492025-01-11T05:33:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27502025-01-11T05:33:00.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27512025-01-11T05:33:00.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
27522025-01-11T05:33:00.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27532025-01-11T05:33:00.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27542025-01-11T05:33:00.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
27552025-01-11T05:33:00.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.113304ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
27562025-01-11T05:33:00.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27572025-01-11T05:33:00.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27582025-01-11T05:33:00.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.951537ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27592025-01-11T05:33:00.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58291a7e-25e1-4823-865a-55b949c531c9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27602025-01-11T05:33:00.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58291a7e-25e1-4823-865a-55b949c531c9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27612025-01-11T05:33:00.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58291a7e-25e1-4823-865a-55b949c531c9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27622025-01-11T05:33:01.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5bca798-1f55-4b2f-8c9f-cefe94489c40 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27632025-01-11T05:33:01.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5bca798-1f55-4b2f-8c9f-cefe94489c40 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27642025-01-11T05:33:01.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5bca798-1f55-4b2f-8c9f-cefe94489c40 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27652025-01-11T05:33:02.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 09d43bb8-60e2-48f2-8dac-5d1a94cea4dc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27662025-01-11T05:33:02.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 09d43bb8-60e2-48f2-8dac-5d1a94cea4dc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27672025-01-11T05:33:02.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 09d43bb8-60e2-48f2-8dac-5d1a94cea4dc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27682025-01-11T05:33:03.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6cd52ce1-d1e0-4800-9375-7c2bd4691fe6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27692025-01-11T05:33:03.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6cd52ce1-d1e0-4800-9375-7c2bd4691fe6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27702025-01-11T05:33:03.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6cd52ce1-d1e0-4800-9375-7c2bd4691fe6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27712025-01-11T05:33:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 75c42d1b-3b02-43f3-a223-b00d31791390 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
27722025-01-11T05:33:04.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e5fa6c3-68da-4065-a229-8ff7fdffd17a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27732025-01-11T05:33:04.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e5fa6c3-68da-4065-a229-8ff7fdffd17a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27742025-01-11T05:33:04.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e5fa6c3-68da-4065-a229-8ff7fdffd17a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27752025-01-11T05:33:05.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64d43ed1-0765-4d7c-8e4d-cc241db9c4da roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27762025-01-11T05:33:05.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64d43ed1-0765-4d7c-8e4d-cc241db9c4da resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27772025-01-11T05:33:05.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64d43ed1-0765-4d7c-8e4d-cc241db9c4da response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27782025-01-11T05:33:06.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36cb22cc-6307-45d2-af80-ad60b965f5c8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27792025-01-11T05:33:06.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36cb22cc-6307-45d2-af80-ad60b965f5c8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27802025-01-11T05:33:06.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36cb22cc-6307-45d2-af80-ad60b965f5c8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27812025-01-11T05:33:07.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5486542c-ca80-4cf9-9dbe-c51356b34649 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27822025-01-11T05:33:07.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5486542c-ca80-4cf9-9dbe-c51356b34649 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27832025-01-11T05:33:07.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5486542c-ca80-4cf9-9dbe-c51356b34649 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27842025-01-11T05:33:08.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 186739e3-cb90-4584-8be8-a11f96aecf22 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27852025-01-11T05:33:08.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 186739e3-cb90-4584-8be8-a11f96aecf22 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27862025-01-11T05:33:08.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 186739e3-cb90-4584-8be8-a11f96aecf22 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27872025-01-11T05:33:09.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 856cea02-005d-4950-8521-5d6156a84c43 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27882025-01-11T05:33:09.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 856cea02-005d-4950-8521-5d6156a84c43 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27892025-01-11T05:33:09.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 856cea02-005d-4950-8521-5d6156a84c43 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
27902025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
27912025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
27922025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27932025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27942025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
27952025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27962025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
27972025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
27982025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27992025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28002025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
28012025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28022025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
28032025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28042025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28052025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
28062025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
28072025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28082025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
28092025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
28102025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28112025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28122025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
28132025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28142025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
28152025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
28162025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28172025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
28182025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28192025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28202025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
28212025-01-11T05:33:10.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28222025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28232025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28242025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28252025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28262025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28272025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28282025-01-11T05:33:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28292025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28302025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28312025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28322025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28332025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28342025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28352025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28362025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28372025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28382025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
28392025-01-11T05:33:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28402025-01-11T05:33:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28412025-01-11T05:33:10.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.626517ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
28422025-01-11T05:33:10.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1530, tv_nsec: 160387169 } })
28432025-01-11T05:33:10.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28442025-01-11T05:33:10.604ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
28452025-01-11T05:33:10.604ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.364394ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28462025-01-11T05:33:10.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28472025-01-11T05:33:10.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28482025-01-11T05:33:10.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28492025-01-11T05:33:10.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28502025-01-11T05:33:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28512025-01-11T05:33:10.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28522025-01-11T05:33:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28532025-01-11T05:33:10.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542025-01-11T05:33:10.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1530, tv_nsec: 166683717 } })
28552025-01-11T05:33:10.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
28562025-01-11T05:33:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28572025-01-11T05:33:10.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28582025-01-11T05:33:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28592025-01-11T05:33:10.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28602025-01-11T05:33:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28612025-01-11T05:33:10.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1530, tv_nsec: 172901563 } })
28622025-01-11T05:33:10.616ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
28632025-01-11T05:33:10.618ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28642025-01-11T05:33:10.618ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.158356ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28652025-01-11T05:33:10.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28662025-01-11T05:33:10.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28672025-01-11T05:33:10.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28682025-01-11T05:33:10.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28692025-01-11T05:33:10.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28702025-01-11T05:33:10.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28712025-01-11T05:33:10.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28722025-01-11T05:33:10.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28732025-01-11T05:33:10.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28742025-01-11T05:33:10.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28752025-01-11T05:33:10.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.989411ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
28762025-01-11T05:33:10.646ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28772025-01-11T05:33:10.646ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28782025-01-11T05:33:10.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28792025-01-11T05:33:10.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28802025-01-11T05:33:10.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28812025-01-11T05:33:10.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28822025-01-11T05:33:10.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28832025-01-11T05:33:10.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28842025-01-11T05:33:10.650ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28852025-01-11T05:33:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28862025-01-11T05:33:10.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28872025-01-11T05:33:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28882025-01-11T05:33:10.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28892025-01-11T05:33:10.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28902025-01-11T05:33:10.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28912025-01-11T05:33:10.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28922025-01-11T05:33:10.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28932025-01-11T05:33:10.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28942025-01-11T05:33:10.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28952025-01-11T05:33:10.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28962025-01-11T05:33:10.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28972025-01-11T05:33:10.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28982025-01-11T05:33:10.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28992025-01-11T05:33:10.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29002025-01-11T05:33:10.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29012025-01-11T05:33:10.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29022025-01-11T05:33:10.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29032025-01-11T05:33:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
29042025-01-11T05:33:10.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29052025-01-11T05:33:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29062025-01-11T05:33:10.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.725762ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29072025-01-11T05:33:10.683ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29082025-01-11T05:33:10.683ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29092025-01-11T05:33:10.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.700798ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29102025-01-11T05:33:10.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112025-01-11T05:33:10.684ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
29122025-01-11T05:33:10.684ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.825813ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
29132025-01-11T05:33:10.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.887455ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29142025-01-11T05:33:10.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29152025-01-11T05:33:10.688ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29162025-01-11T05:33:10.690ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00faec84-f651-4681-adae-f8cc5f88fcbd", "content-length": "26", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29172025-01-11T05:33:10.690ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29182025-01-11T05:33:10.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29192025-01-11T05:33:10.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
29202025-01-11T05:33:10.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29212025-01-11T05:33:10.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29222025-01-11T05:33:10.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.057472ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29232025-01-11T05:33:10.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29242025-01-11T05:33:10.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29252025-01-11T05:33:10.693ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.022635ms iteration = 20 status = 0
29262025-01-11T05:33:10.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29272025-01-11T05:33:10.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29282025-01-11T05:33:10.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29292025-01-11T05:33:10.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29302025-01-11T05:33:10.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29312025-01-11T05:33:10.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29322025-01-11T05:33:10.698ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29332025-01-11T05:33:10.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29342025-01-11T05:33:10.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
29352025-01-11T05:33:10.707ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29362025-01-11T05:33:10.707ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3aeb085-e5d6-4477-bdeb-ed315f8aafda", "content-length": "26", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29372025-01-11T05:33:10.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29382025-01-11T05:33:10.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
29392025-01-11T05:33:10.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29402025-01-11T05:33:10.709ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29412025-01-11T05:33:10.710ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb2e92e4-293f-4ee7-91af-c7ffb50dfd52", "content-length": "26", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29422025-01-11T05:33:10.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29432025-01-11T05:33:10.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29442025-01-11T05:33:10.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.513355ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29452025-01-11T05:33:10.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29462025-01-11T05:33:10.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29472025-01-11T05:33:10.739ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.985011ms iteration = 22 status = {"physical_disks_added":0}
29482025-01-11T05:33:10.763ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29492025-01-11T05:33:10.764ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "870e387d-e81f-433e-9013-91606c4e832d", "content-length": "1", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29502025-01-11T05:33:10.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29512025-01-11T05:33:10.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29522025-01-11T05:33:10.768ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 166.73118ms iteration = 20 status = null
29532025-01-11T05:33:10.790ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.65918ms iteration = 20 status = {}
29542025-01-11T05:33:10.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29552025-01-11T05:33:10.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29562025-01-11T05:33:10.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29572025-01-11T05:33:10.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29582025-01-11T05:33:10.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29592025-01-11T05:33:10.829ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29602025-01-11T05:33:10.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29612025-01-11T05:33:10.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29622025-01-11T05:33:10.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4a805b0-cdba-4738-9e89-037dd47c57ff", "content-length": "372", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29632025-01-11T05:33:10.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29642025-01-11T05:33:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29652025-01-11T05:33:10.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29662025-01-11T05:33:10.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29672025-01-11T05:33:10.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29682025-01-11T05:33:10.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29692025-01-11T05:33:10.873ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29702025-01-11T05:33:10.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29712025-01-11T05:33:10.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e3953b12-0b9b-4caa-845b-c4604893b19a", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29722025-01-11T05:33:10.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29732025-01-11T05:33:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29742025-01-11T05:33:10.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29752025-01-11T05:33:10.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29762025-01-11T05:33:10.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29772025-01-11T05:33:10.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29782025-01-11T05:33:10.878ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
29792025-01-11T05:33:10.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29802025-01-11T05:33:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29812025-01-11T05:33:10.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822025-01-11T05:33:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29832025-01-11T05:33:10.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bc074eb3-6a58-45a2-af2e-16744a6b361e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
29842025-01-11T05:33:10.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bc074eb3-6a58-45a2-af2e-16744a6b361e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
29852025-01-11T05:33:10.903ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29862025-01-11T05:33:10.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4db13e5-8699-4ea5-840c-e6f6e102c9ee", "content-length": "691", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29872025-01-11T05:33:10.903ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29882025-01-11T05:33:10.903ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29892025-01-11T05:33:10.903ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29902025-01-11T05:33:10.904ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 303.061324ms iteration = 20 status = {}
29912025-01-11T05:33:10.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bc074eb3-6a58-45a2-af2e-16744a6b361e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
29922025-01-11T05:33:10.907ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29932025-01-11T05:33:10.907ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29942025-01-11T05:33:10.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29952025-01-11T05:33:10.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "00d02ed1-9e95-4682-8108-5bad4d33b06b", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29962025-01-11T05:33:10.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8b9b495-5611-4a39-89f5-be9f9013dc6e", "content-length": "134", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
29972025-01-11T05:33:10.913ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29982025-01-11T05:33:10.913ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
29992025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30002025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30012025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30022025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30032025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30042025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30052025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30062025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30072025-01-11T05:33:10.914ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
30082025-01-11T05:33:10.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30092025-01-11T05:33:10.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30102025-01-11T05:33:10.915ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.537253ms iteration = 20 status = {}
30112025-01-11T05:33:10.916ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30122025-01-11T05:33:10.916ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "60367436-920f-46fb-a716-c9c8da3d5e63", "content-length": "2", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
30132025-01-11T05:33:10.916ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30142025-01-11T05:33:10.916ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc8a24e8-8b10-4e5e-afd0-91e1c7833628", "content-length": "52", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
30152025-01-11T05:33:10.916ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
30162025-01-11T05:33:10.916ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30172025-01-11T05:33:11.011ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "196cff14-4182-4381-9dac-d7a3dd163bcb", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
30182025-01-11T05:33:11.011ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
30192025-01-11T05:33:11.011ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30202025-01-11T05:33:11.011ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4f8ed8-3e32-4810-846c-02fe45e082fe", "content-length": "682", "date": "Sat, 11 Jan 2025 05:33:10 GMT"} })
30212025-01-11T05:33:11.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30222025-01-11T05:33:11.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30232025-01-11T05:33:11.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30242025-01-11T05:33:11.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30252025-01-11T05:33:11.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30262025-01-11T05:33:11.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30272025-01-11T05:33:11.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30282025-01-11T05:33:11.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30292025-01-11T05:33:11.028ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 426.554498ms iteration = 20 status = {}
30302025-01-11T05:33:11.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 80894903-aa96-4f23-b6e1-e949c6f091ce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30312025-01-11T05:33:11.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 80894903-aa96-4f23-b6e1-e949c6f091ce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30322025-01-11T05:33:11.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 80894903-aa96-4f23-b6e1-e949c6f091ce response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30332025-01-11T05:33:12.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec383f37-624c-4327-842c-6f7025f1e95e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30342025-01-11T05:33:12.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec383f37-624c-4327-842c-6f7025f1e95e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30352025-01-11T05:33:12.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec383f37-624c-4327-842c-6f7025f1e95e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30362025-01-11T05:33:13.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 753b8702-5939-4ae1-ac42-2389d0ba2ce2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30372025-01-11T05:33:13.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 753b8702-5939-4ae1-ac42-2389d0ba2ce2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30382025-01-11T05:33:13.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 753b8702-5939-4ae1-ac42-2389d0ba2ce2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30392025-01-11T05:33:13.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 546 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 7f3d6f79-10e9-466d-bb15-af6271fac32a response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
30402025-01-11T05:33:14.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19bedf31-b638-453f-a600-0a08c8b60e09 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30412025-01-11T05:33:14.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19bedf31-b638-453f-a600-0a08c8b60e09 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30422025-01-11T05:33:14.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19bedf31-b638-453f-a600-0a08c8b60e09 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30432025-01-11T05:33:15.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5832f3e2-c90a-4cb1-bf0a-1eeb07c01a6a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30442025-01-11T05:33:15.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5832f3e2-c90a-4cb1-bf0a-1eeb07c01a6a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30452025-01-11T05:33:15.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5832f3e2-c90a-4cb1-bf0a-1eeb07c01a6a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30462025-01-11T05:33:16.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ea39d04d-afab-4403-b2a8-932816f8e8b0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30472025-01-11T05:33:16.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ea39d04d-afab-4403-b2a8-932816f8e8b0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30482025-01-11T05:33:16.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ea39d04d-afab-4403-b2a8-932816f8e8b0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30492025-01-11T05:33:17.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51d8e012-6a7f-4ad7-b70a-d4c849a6cecb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30502025-01-11T05:33:17.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51d8e012-6a7f-4ad7-b70a-d4c849a6cecb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30512025-01-11T05:33:17.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51d8e012-6a7f-4ad7-b70a-d4c849a6cecb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30522025-01-11T05:33:18.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 112f9182-1eb1-433c-b728-8914af17214e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30532025-01-11T05:33:18.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 112f9182-1eb1-433c-b728-8914af17214e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30542025-01-11T05:33:18.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 112f9182-1eb1-433c-b728-8914af17214e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30552025-01-11T05:33:19.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c14527ff-9290-4909-91f3-8fe45b749ca8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30562025-01-11T05:33:19.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c14527ff-9290-4909-91f3-8fe45b749ca8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30572025-01-11T05:33:19.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c14527ff-9290-4909-91f3-8fe45b749ca8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30582025-01-11T05:33:20.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cfa9d96b-7876-4540-8810-0445290ecfcc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30592025-01-11T05:33:20.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cfa9d96b-7876-4540-8810-0445290ecfcc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30602025-01-11T05:33:20.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cfa9d96b-7876-4540-8810-0445290ecfcc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30612025-01-11T05:33:20.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
30622025-01-11T05:33:20.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30632025-01-11T05:33:20.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
30642025-01-11T05:33:20.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30652025-01-11T05:33:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30662025-01-11T05:33:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30672025-01-11T05:33:20.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30682025-01-11T05:33:20.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30692025-01-11T05:33:20.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30702025-01-11T05:33:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30712025-01-11T05:33:20.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30722025-01-11T05:33:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30732025-01-11T05:33:20.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30742025-01-11T05:33:20.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30752025-01-11T05:33:20.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30762025-01-11T05:33:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
30772025-01-11T05:33:20.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30782025-01-11T05:33:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30792025-01-11T05:33:20.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
30802025-01-11T05:33:20.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.345575ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
30812025-01-11T05:33:20.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.231657ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30822025-01-11T05:33:21.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a45c6aff-456f-4223-9b0e-63e1001a07de roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30832025-01-11T05:33:21.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a45c6aff-456f-4223-9b0e-63e1001a07de resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30842025-01-11T05:33:21.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a45c6aff-456f-4223-9b0e-63e1001a07de response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30852025-01-11T05:33:22.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2cb3ec6b-7e51-43c6-921b-e09f6781b5a6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30862025-01-11T05:33:22.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2cb3ec6b-7e51-43c6-921b-e09f6781b5a6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30872025-01-11T05:33:22.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2cb3ec6b-7e51-43c6-921b-e09f6781b5a6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30882025-01-11T05:33:23.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 519f7778-df68-4163-8b13-3742c80d72fb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30892025-01-11T05:33:23.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 519f7778-df68-4163-8b13-3742c80d72fb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30902025-01-11T05:33:23.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 519f7778-df68-4163-8b13-3742c80d72fb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30912025-01-11T05:33:23.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 548893f8-c279-4107-923d-eaa838ce31ca roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
30922025-01-11T05:33:23.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 548893f8-c279-4107-923d-eaa838ce31ca resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
30932025-01-11T05:33:23.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 548893f8-c279-4107-923d-eaa838ce31ca response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
30942025-01-11T05:33:23.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 69ca4c0a-6b90-413b-b59b-cc6cd63b28a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
30952025-01-11T05:33:23.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 69ca4c0a-6b90-413b-b59b-cc6cd63b28a8 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
30962025-01-11T05:33:23.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 69ca4c0a-6b90-413b-b59b-cc6cd63b28a8 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
30972025-01-11T05:33:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = c260e594-95cf-4504-9d7e-700d9dbb7538 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
30982025-01-11T05:33:24.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 80f1bf78-bbd9-4ae4-b120-3c6fc752ea3b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
30992025-01-11T05:33:24.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 80f1bf78-bbd9-4ae4-b120-3c6fc752ea3b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31002025-01-11T05:33:24.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 80f1bf78-bbd9-4ae4-b120-3c6fc752ea3b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31012025-01-11T05:33:25.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3b61288-240f-4079-b883-a16a6eb10bad roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31022025-01-11T05:33:25.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3b61288-240f-4079-b883-a16a6eb10bad resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31032025-01-11T05:33:25.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3b61288-240f-4079-b883-a16a6eb10bad response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31042025-01-11T05:33:26.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ab945872-51dc-47df-b9a9-761f44351ed9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31052025-01-11T05:33:26.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ab945872-51dc-47df-b9a9-761f44351ed9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31062025-01-11T05:33:26.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ab945872-51dc-47df-b9a9-761f44351ed9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31072025-01-11T05:33:27.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f0117218-356b-4935-962c-461c47c328b7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31082025-01-11T05:33:27.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f0117218-356b-4935-962c-461c47c328b7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31092025-01-11T05:33:27.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f0117218-356b-4935-962c-461c47c328b7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31102025-01-11T05:33:28.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 65c55b40-1a5f-4b42-981a-eac4c950f10b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31112025-01-11T05:33:28.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 65c55b40-1a5f-4b42-981a-eac4c950f10b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31122025-01-11T05:33:28.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 65c55b40-1a5f-4b42-981a-eac4c950f10b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31132025-01-11T05:33:29.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 14274660-5a2a-47a6-acc8-eff080e335fd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31142025-01-11T05:33:29.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 14274660-5a2a-47a6-acc8-eff080e335fd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31152025-01-11T05:33:29.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 14274660-5a2a-47a6-acc8-eff080e335fd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31162025-01-11T05:33:30.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1becc5fa-4cf0-4d52-8cc2-c6a9f53b73b1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31172025-01-11T05:33:30.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1becc5fa-4cf0-4d52-8cc2-c6a9f53b73b1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31182025-01-11T05:33:30.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1becc5fa-4cf0-4d52-8cc2-c6a9f53b73b1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31192025-01-11T05:33:30.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
31202025-01-11T05:33:30.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
31212025-01-11T05:33:30.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31222025-01-11T05:33:30.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31232025-01-11T05:33:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31242025-01-11T05:33:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31252025-01-11T05:33:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31262025-01-11T05:33:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31272025-01-11T05:33:30.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.067898ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31282025-01-11T05:33:30.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31292025-01-11T05:33:30.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31302025-01-11T05:33:30.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31312025-01-11T05:33:30.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31322025-01-11T05:33:30.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31332025-01-11T05:33:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31342025-01-11T05:33:30.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31352025-01-11T05:33:30.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
31362025-01-11T05:33:30.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31372025-01-11T05:33:30.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31382025-01-11T05:33:30.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
31392025-01-11T05:33:30.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.728536ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
31402025-01-11T05:33:31.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc311e93-f224-495e-a4b1-5c9c8c1dc383 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31412025-01-11T05:33:31.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc311e93-f224-495e-a4b1-5c9c8c1dc383 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31422025-01-11T05:33:31.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc311e93-f224-495e-a4b1-5c9c8c1dc383 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31432025-01-11T05:33:32.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4705edbf-0457-409a-9624-34bb69cb3a09 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31442025-01-11T05:33:32.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4705edbf-0457-409a-9624-34bb69cb3a09 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31452025-01-11T05:33:32.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4705edbf-0457-409a-9624-34bb69cb3a09 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31462025-01-11T05:33:33.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 682af607-3b97-42f2-84dd-ad313604578a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31472025-01-11T05:33:33.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 682af607-3b97-42f2-84dd-ad313604578a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31482025-01-11T05:33:33.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 682af607-3b97-42f2-84dd-ad313604578a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31492025-01-11T05:33:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 618 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 0c3e1d76-1c28-4c1e-89be-935cef610dbe response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
31502025-01-11T05:33:34.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ffb87af6-fb0b-41ae-8dce-98162bc59ebc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31512025-01-11T05:33:34.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ffb87af6-fb0b-41ae-8dce-98162bc59ebc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31522025-01-11T05:33:34.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ffb87af6-fb0b-41ae-8dce-98162bc59ebc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31532025-01-11T05:33:35.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51b227a9-f3d8-4957-b646-a6dc06b03e0e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31542025-01-11T05:33:35.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51b227a9-f3d8-4957-b646-a6dc06b03e0e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31552025-01-11T05:33:35.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51b227a9-f3d8-4957-b646-a6dc06b03e0e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31562025-01-11T05:33:36.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e34f7c13-104a-481b-b1ac-fc1028158044 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31572025-01-11T05:33:36.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e34f7c13-104a-481b-b1ac-fc1028158044 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31582025-01-11T05:33:36.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e34f7c13-104a-481b-b1ac-fc1028158044 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31592025-01-11T05:33:37.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 74170479-252c-48e7-8d68-93b52fde38bc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31602025-01-11T05:33:37.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 74170479-252c-48e7-8d68-93b52fde38bc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31612025-01-11T05:33:37.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 74170479-252c-48e7-8d68-93b52fde38bc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31622025-01-11T05:33:38.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1d506490-efe9-4b6e-97ed-f532fd633b34 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31632025-01-11T05:33:38.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1d506490-efe9-4b6e-97ed-f532fd633b34 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31642025-01-11T05:33:38.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1d506490-efe9-4b6e-97ed-f532fd633b34 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31652025-01-11T05:33:39.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e178849e-9e31-4758-b917-e1ad3d13b6cd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31662025-01-11T05:33:39.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e178849e-9e31-4758-b917-e1ad3d13b6cd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31672025-01-11T05:33:39.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e178849e-9e31-4758-b917-e1ad3d13b6cd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
31682025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
31692025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
31702025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31712025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
31722025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31732025-01-11T05:33:40.602ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
31742025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31752025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
31762025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
31772025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31782025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
31792025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31802025-01-11T05:33:40.602ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
31812025-01-11T05:33:40.602ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
31822025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
31832025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31842025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31852025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
31862025-01-11T05:33:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31872025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
31882025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31892025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31902025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
31912025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31922025-01-11T05:33:40.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:23:40.602605034 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31932025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
31942025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31952025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31962025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31972025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
31982025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
31992025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32002025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
32012025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
32022025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
32032025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32042025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32052025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
32062025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
32072025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32082025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32092025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
32102025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32112025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
32122025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
32132025-01-11T05:33:40.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32142025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32152025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
32162025-01-11T05:33:40.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
32172025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.57\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
32182025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
32192025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
32202025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32212025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
32222025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32232025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
32242025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32252025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
32262025-01-11T05:33:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32272025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
32282025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32292025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
32302025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
32312025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
32322025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32332025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32342025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
32352025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32362025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
32372025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32382025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32392025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32402025-01-11T05:33:40.603ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
32412025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32422025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32432025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32442025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32452025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32462025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32472025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32482025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32492025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32502025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32512025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32522025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32532025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32542025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32552025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32562025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32572025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32582025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32592025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32602025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32612025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32622025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32632025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32642025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32652025-01-11T05:33:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 159490356 } })
32662025-01-11T05:33:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 159528327 } })
32672025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
32682025-01-11T05:33:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.046943ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32692025-01-11T05:33:40.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32702025-01-11T05:33:40.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.268158ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32712025-01-11T05:33:40.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 161512950 } })
32722025-01-11T05:33:40.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32732025-01-11T05:33:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.734321ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32742025-01-11T05:33:40.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32752025-01-11T05:33:40.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32762025-01-11T05:33:40.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32772025-01-11T05:33:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32782025-01-11T05:33:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32792025-01-11T05:33:40.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32802025-01-11T05:33:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32812025-01-11T05:33:40.608ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.706505ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
32822025-01-11T05:33:40.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32832025-01-11T05:33:40.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32842025-01-11T05:33:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32852025-01-11T05:33:40.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32862025-01-11T05:33:40.611ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:23:40.602605034 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32872025-01-11T05:33:40.611ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.071589ms iteration = 11 status = {"expiration":"2025-01-11T05:23:40.602605034Z","pruned":[]}
32882025-01-11T05:33:40.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32892025-01-11T05:33:40.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902025-01-11T05:33:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32912025-01-11T05:33:40.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.452064ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
32922025-01-11T05:33:40.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32932025-01-11T05:33:40.619ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 175287272 } })
32942025-01-11T05:33:40.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
32952025-01-11T05:33:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32962025-01-11T05:33:40.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32972025-01-11T05:33:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32982025-01-11T05:33:40.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32992025-01-11T05:33:40.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33002025-01-11T05:33:40.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33012025-01-11T05:33:40.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33022025-01-11T05:33:40.638ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33032025-01-11T05:33:40.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33042025-01-11T05:33:40.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33052025-01-11T05:33:40.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33062025-01-11T05:33:40.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33072025-01-11T05:33:40.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33082025-01-11T05:33:40.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6e4f6221-6049-4495-be67-1a31f0c85b09 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
33092025-01-11T05:33:40.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33102025-01-11T05:33:40.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33112025-01-11T05:33:40.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6e4f6221-6049-4495-be67-1a31f0c85b09 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
33122025-01-11T05:33:40.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.750741ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
33132025-01-11T05:33:40.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33142025-01-11T05:33:40.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33152025-01-11T05:33:40.656ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33162025-01-11T05:33:40.656ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33172025-01-11T05:33:40.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33182025-01-11T05:33:40.657ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192025-01-11T05:33:40.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33202025-01-11T05:33:40.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33212025-01-11T05:33:40.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33222025-01-11T05:33:40.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33232025-01-11T05:33:40.660ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33242025-01-11T05:33:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33252025-01-11T05:33:40.661ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33262025-01-11T05:33:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33272025-01-11T05:33:40.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33282025-01-11T05:33:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33292025-01-11T05:33:40.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33302025-01-11T05:33:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33312025-01-11T05:33:40.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33322025-01-11T05:33:40.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33332025-01-11T05:33:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
33342025-01-11T05:33:40.665ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33352025-01-11T05:33:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33362025-01-11T05:33:40.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33372025-01-11T05:33:40.665ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33382025-01-11T05:33:40.665ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33392025-01-11T05:33:40.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33402025-01-11T05:33:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33412025-01-11T05:33:40.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33422025-01-11T05:33:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33432025-01-11T05:33:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33442025-01-11T05:33:40.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33452025-01-11T05:33:40.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33462025-01-11T05:33:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33472025-01-11T05:33:40.669ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33482025-01-11T05:33:40.669ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33492025-01-11T05:33:40.669ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.654739ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33502025-01-11T05:33:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33512025-01-11T05:33:40.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33522025-01-11T05:33:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33532025-01-11T05:33:40.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542025-01-11T05:33:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33552025-01-11T05:33:40.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33562025-01-11T05:33:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33572025-01-11T05:33:40.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6e4f6221-6049-4495-be67-1a31f0c85b09 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
33582025-01-11T05:33:40.673ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33592025-01-11T05:33:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33602025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33612025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33622025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33632025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33642025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33652025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33662025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33672025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
33682025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33692025-01-11T05:33:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33702025-01-11T05:33:40.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33712025-01-11T05:33:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33722025-01-11T05:33:40.678ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33732025-01-11T05:33:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33742025-01-11T05:33:40.680ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
33752025-01-11T05:33:40.680ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 77.778973ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
33762025-01-11T05:33:40.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33772025-01-11T05:33:40.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33782025-01-11T05:33:40.701ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33792025-01-11T05:33:40.701ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33802025-01-11T05:33:40.701ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.501626ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33812025-01-11T05:33:40.713ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33822025-01-11T05:33:40.713ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33832025-01-11T05:33:40.713ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33842025-01-11T05:33:40.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33852025-01-11T05:33:40.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33862025-01-11T05:33:40.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33872025-01-11T05:33:40.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33882025-01-11T05:33:40.716ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33892025-01-11T05:33:40.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.73036ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33902025-01-11T05:33:40.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33912025-01-11T05:33:40.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33922025-01-11T05:33:40.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33932025-01-11T05:33:40.743ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
33942025-01-11T05:33:40.743ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33952025-01-11T05:33:40.743ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70a6f4b9-1d2e-4ca6-81a0-8291b50de0ad", "content-length": "26", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
33962025-01-11T05:33:40.743ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33972025-01-11T05:33:40.745ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33982025-01-11T05:33:40.745ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33992025-01-11T05:33:40.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34002025-01-11T05:33:40.763ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34012025-01-11T05:33:40.764ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99e49808-0802-45ba-a36d-82a1c803d8bb", "content-length": "26", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
34022025-01-11T05:33:40.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34032025-01-11T05:33:40.765ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34042025-01-11T05:33:40.856ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34052025-01-11T05:33:40.874ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34062025-01-11T05:33:40.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34072025-01-11T05:33:40.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec5e8d20-20c8-4c27-a0f3-6752ba08a8f7", "content-length": "372", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
34082025-01-11T05:33:40.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34092025-01-11T05:33:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34102025-01-11T05:33:40.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34112025-01-11T05:33:40.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34122025-01-11T05:33:40.877ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34132025-01-11T05:33:40.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34142025-01-11T05:33:40.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cc8b1794-c497-463f-8bdc-912bb4d9e4c8", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34152025-01-11T05:33:40.877ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34162025-01-11T05:33:40.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34172025-01-11T05:33:40.879ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "76076ef7-140c-4fbc-b3bd-8d6b44855d6d", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34182025-01-11T05:33:40.879ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34192025-01-11T05:33:40.879ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 435538799 } })
34202025-01-11T05:33:40.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34212025-01-11T05:33:40.879ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
34222025-01-11T05:33:40.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34232025-01-11T05:33:40.881ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34242025-01-11T05:33:40.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 279.155591ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34252025-01-11T05:33:40.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262025-01-11T05:33:40.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34272025-01-11T05:33:40.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34282025-01-11T05:33:40.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34292025-01-11T05:33:40.888ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(e729483e-44fe-44ae-b00e-e5da5277ea5c, 0), (4e96c9ae-dd21-431c-8888-ac64be0a7699, 0), (289bf2e9-1f4c-4463-8c74-867c3a06297e, 0), (bcbb09f0-309e-4552-a535-b735d6f61136, 0)] collection_id = e729483e-44fe-44ae-b00e-e5da5277ea5c
34302025-01-11T05:33:40.888ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34312025-01-11T05:33:40.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34322025-01-11T05:33:40.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
34332025-01-11T05:33:40.893ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 290.241294ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
34342025-01-11T05:33:40.897ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.696171ms iteration = 21 status = {}
34352025-01-11T05:33:40.909ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34362025-01-11T05:33:40.909ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34372025-01-11T05:33:40.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 306.410507ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34382025-01-11T05:33:40.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34392025-01-11T05:33:40.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34402025-01-11T05:33:40.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34412025-01-11T05:33:40.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34422025-01-11T05:33:40.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34432025-01-11T05:33:40.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34442025-01-11T05:33:40.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 310.593989ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34452025-01-11T05:33:40.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462025-01-11T05:33:40.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472025-01-11T05:33:40.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34482025-01-11T05:33:40.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34492025-01-11T05:33:40.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 314.368332ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34502025-01-11T05:33:40.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34512025-01-11T05:33:40.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34522025-01-11T05:33:40.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34532025-01-11T05:33:40.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34542025-01-11T05:33:40.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34552025-01-11T05:33:40.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34562025-01-11T05:33:40.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 317.298466ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34572025-01-11T05:33:40.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582025-01-11T05:33:40.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592025-01-11T05:33:40.924ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34602025-01-11T05:33:40.924ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
34612025-01-11T05:33:40.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34622025-01-11T05:33:40.924ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34632025-01-11T05:33:40.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34642025-01-11T05:33:40.925ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea6e83a6-c568-4d7f-8d2c-5e1b40868e17", "content-length": "1", "date": "Sat, 11 Jan 2025 05:33:39 GMT"} })
34652025-01-11T05:33:40.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
34662025-01-11T05:33:40.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34672025-01-11T05:33:40.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34682025-01-11T05:33:40.926ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34692025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34702025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34712025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34722025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34732025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34752025-01-11T05:33:40.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34762025-01-11T05:33:40.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34772025-01-11T05:33:40.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34782025-01-11T05:33:40.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34792025-01-11T05:33:40.931ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.114875ms iteration = 21 status = null
34802025-01-11T05:33:40.937ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
34812025-01-11T05:33:40.937ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34822025-01-11T05:33:40.937ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
34832025-01-11T05:33:40.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 332.931428ms iteration = 11 status = {"generation":2}
34842025-01-11T05:33:40.943ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34852025-01-11T05:33:40.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34862025-01-11T05:33:40.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34872025-01-11T05:33:40.943ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52d3f1fb-8833-4c97-a016-28aa29fd5e76", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
34882025-01-11T05:33:40.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34892025-01-11T05:33:40.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34902025-01-11T05:33:40.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34912025-01-11T05:33:40.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34922025-01-11T05:33:40.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34932025-01-11T05:33:40.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34942025-01-11T05:33:40.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
34952025-01-11T05:33:40.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34962025-01-11T05:33:40.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34972025-01-11T05:33:40.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34982025-01-11T05:33:40.949ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "603e5c55-6051-4747-bf3f-d4a3784c2600", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34992025-01-11T05:33:40.949ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35002025-01-11T05:33:40.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35012025-01-11T05:33:40.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35022025-01-11T05:33:40.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35032025-01-11T05:33:40.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35042025-01-11T05:33:40.952ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1c07d408-1340-4ce1-a1ef-30a04a832fe3", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35052025-01-11T05:33:40.952ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35062025-01-11T05:33:40.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35072025-01-11T05:33:40.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35082025-01-11T05:33:40.954ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35092025-01-11T05:33:40.954ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35102025-01-11T05:33:40.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "46de9081-dbf6-4a73-9d5f-818b53e7e55e", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35112025-01-11T05:33:40.954ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35122025-01-11T05:33:40.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f9450658-beb0-499b-a62b-3811733a1db7", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
35132025-01-11T05:33:40.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35142025-01-11T05:33:40.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35152025-01-11T05:33:40.956ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.773904ms iteration = 21 status = {}
35162025-01-11T05:33:40.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35172025-01-11T05:33:40.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 354.48791ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35182025-01-11T05:33:40.957ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35192025-01-11T05:33:40.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35202025-01-11T05:33:40.957ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 354.532932ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35212025-01-11T05:33:40.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35222025-01-11T05:33:40.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35232025-01-11T05:33:40.959ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = e729483e-44fe-44ae-b00e-e5da5277ea5c file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
35242025-01-11T05:33:40.959ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
35252025-01-11T05:33:40.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
35262025-01-11T05:33:40.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
35272025-01-11T05:33:40.959ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35282025-01-11T05:33:40.960ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "016dab4d-bcec-4761-8e6c-af84d5fa956e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
35292025-01-11T05:33:40.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35302025-01-11T05:33:40.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35312025-01-11T05:33:40.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35322025-01-11T05:33:40.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
35332025-01-11T05:33:40.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35342025-01-11T05:33:40.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35352025-01-11T05:33:40.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35362025-01-11T05:33:40.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35372025-01-11T05:33:40.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35382025-01-11T05:33:40.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35392025-01-11T05:33:40.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35402025-01-11T05:33:40.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35412025-01-11T05:33:40.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35422025-01-11T05:33:40.970ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35432025-01-11T05:33:40.970ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35442025-01-11T05:33:40.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35452025-01-11T05:33:40.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35462025-01-11T05:33:40.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
35472025-01-11T05:33:40.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35482025-01-11T05:33:40.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35492025-01-11T05:33:40.972ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4e96c9ae-dd21-431c-8888-ac64be0a7699, 0), (289bf2e9-1f4c-4463-8c74-867c3a06297e, 0), (bcbb09f0-309e-4552-a535-b735d6f61136, 0)]
35502025-01-11T05:33:40.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35512025-01-11T05:33:40.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35522025-01-11T05:33:40.972ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1560, tv_nsec: 528585235 } })
35532025-01-11T05:33:40.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35542025-01-11T05:33:40.973ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
35552025-01-11T05:33:40.973ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 370.817697ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35562025-01-11T05:33:40.973ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 371.101693ms iteration = 21 status = 0
35572025-01-11T05:33:40.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35582025-01-11T05:33:40.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35592025-01-11T05:33:40.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35602025-01-11T05:33:40.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35612025-01-11T05:33:40.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35622025-01-11T05:33:40.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35632025-01-11T05:33:40.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35642025-01-11T05:33:40.977ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35652025-01-11T05:33:40.977ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35662025-01-11T05:33:40.977ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
35672025-01-11T05:33:40.977ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 375.243645ms iteration = 11 status = {"generation":1}
35682025-01-11T05:33:40.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35692025-01-11T05:33:40.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35702025-01-11T05:33:40.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35712025-01-11T05:33:40.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
35722025-01-11T05:33:40.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35732025-01-11T05:33:40.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35742025-01-11T05:33:40.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35752025-01-11T05:33:40.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35762025-01-11T05:33:40.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35772025-01-11T05:33:40.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35782025-01-11T05:33:40.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792025-01-11T05:33:40.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
35802025-01-11T05:33:40.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35812025-01-11T05:33:40.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35822025-01-11T05:33:40.992ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35832025-01-11T05:33:40.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 389.289322ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35842025-01-11T05:33:40.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35852025-01-11T05:33:40.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35862025-01-11T05:33:40.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35872025-01-11T05:33:40.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35882025-01-11T05:33:40.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35892025-01-11T05:33:40.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35902025-01-11T05:33:40.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35912025-01-11T05:33:40.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35922025-01-11T05:33:40.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35932025-01-11T05:33:40.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35942025-01-11T05:33:40.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35952025-01-11T05:33:40.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35962025-01-11T05:33:40.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35972025-01-11T05:33:40.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35982025-01-11T05:33:40.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35992025-01-11T05:33:40.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36002025-01-11T05:33:41.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36012025-01-11T05:33:41.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36022025-01-11T05:33:41.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36032025-01-11T05:33:41.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36042025-01-11T05:33:41.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36052025-01-11T05:33:41.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36062025-01-11T05:33:41.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36072025-01-11T05:33:41.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36082025-01-11T05:33:41.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-01-11T05:33:41.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36102025-01-11T05:33:41.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36112025-01-11T05:33:41.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36122025-01-11T05:33:41.034ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
36132025-01-11T05:33:41.034ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
36142025-01-11T05:33:41.034ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
36152025-01-11T05:33:41.034ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "b54b3272-72a4-4a04-96e6-841dcb4347a5", "content-length": "476", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36162025-01-11T05:33:41.034ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
36172025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "24b13266-e799-429e-9f40-e458d96ef43d", "content-length": "734", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36182025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
36192025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "41dcfad1-0e94-46e4-a1c6-fc49e1353e6a", "content-length": "111", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36202025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
36212025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f07c663-f4b4-402f-9620-f374a8705e92", "content-length": "111", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36222025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
36232025-01-11T05:33:41.035ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1494a300-f393-4eb5-bfd7-0e73c29af931", "content-length": "167", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36242025-01-11T05:33:41.036ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
36252025-01-11T05:33:41.036ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d379203-b6b9-421b-9f92-647ff0efd73c", "content-length": "167", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36262025-01-11T05:33:41.036ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
36272025-01-11T05:33:41.036ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4237609e-93f0-450e-8967-16a70df5e9f2", "content-length": "175", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36282025-01-11T05:33:41.036ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
36292025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "66e65c99-18ce-4577-8961-ee3e42443c28", "content-length": "175", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36302025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
36312025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e375a3a-b922-48c4-a0a4-91ed577394f8", "content-length": "702", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36322025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
36332025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "75778dcb-12b5-4c72-a071-d246c679e427", "content-length": "727", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36342025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
36352025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "96a8895c-9445-44fc-8f15-457eb27cf627", "content-length": "729", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36362025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
36372025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "54c1b302-6ed8-493c-b552-cd81683da398", "content-length": "728", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36382025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
36392025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d10323d3-de49-4950-a72b-3b370d4cb0f1", "content-length": "722", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36402025-01-11T05:33:41.037ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
36412025-01-11T05:33:41.038ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "339b2089-f8e3-4df3-8ca9-e63d206138d3", "content-length": "109", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36422025-01-11T05:33:41.038ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
36432025-01-11T05:33:41.038ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6eb47c5-6f12-48d7-842e-e8c621cc58c9", "content-length": "109", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36442025-01-11T05:33:41.038ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
36452025-01-11T05:33:41.038ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "abc47e8b-59d4-492b-8093-0bad08b9033f", "content-length": "169", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36462025-01-11T05:33:41.038ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
36472025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "73a51705-8d2a-4e6e-8d1a-4986248b1964", "content-length": "169", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36482025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
36492025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "31635ae2-3aea-42f1-adbb-32264e859114", "content-length": "178", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36502025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
36512025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 436.771571ms iteration = 23 status = {"physical_disks_added":0}
36522025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "722c9120-eabd-452b-be3c-51592b1d6e3a", "content-length": "178", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36532025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
36542025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "70af9840-5159-4f01-8dcd-f5503c5657e5", "content-length": "702", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36552025-01-11T05:33:41.039ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
36562025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf22c4d1-4948-425d-8024-2ed55c36ceb3", "content-length": "727", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
36572025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
36582025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4caf103-6c6f-463a-a7a8-ccb53a845468", "content-length": "729", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36592025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
36602025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "52262cff-2146-4813-970d-8e0f90f4c8af", "content-length": "728", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36612025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36622025-01-11T05:33:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36632025-01-11T05:33:41.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36642025-01-11T05:33:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36652025-01-11T05:33:41.042ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662025-01-11T05:33:41.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36672025-01-11T05:33:41.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36682025-01-11T05:33:41.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
36692025-01-11T05:33:41.044ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36702025-01-11T05:33:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36712025-01-11T05:33:41.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722025-01-11T05:33:41.045ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36732025-01-11T05:33:41.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
36742025-01-11T05:33:41.048ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36752025-01-11T05:33:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36762025-01-11T05:33:41.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36772025-01-11T05:33:41.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36782025-01-11T05:33:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36792025-01-11T05:33:41.055ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 3da168c4-8069-45d6-a96c-9bd6e5b1cbe0, kind: Service { id: 41bd7929-21b3-4420-bdfb-4d377eca1275 }, name: Name("nexus-41bd7929-21b3-4420-bdfb-4d377eca1275"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a400d6b-d9c4-4d4f-9a93-9d358fd2213c, kind: Service { id: c65b59c5-6763-4b24-9975-b340540b3788 }, name: Name("nexus-c65b59c5-6763-4b24-9975-b340540b3788"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f2934fe9-7f56-4391-9cbd-73ed0873ef74, kind: Service { id: aa9e7449-5e0d-48f2-bc5e-e67a9910d88d }, name: Name("nexus-aa9e7449-5e0d-48f2-bc5e-e67a9910d88d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4d89a779-1fc1-4488-b830-819ec303eab4, kind: Service { id: 4266b46f-6e12-4383-943a-1dff6b37826d }, name: Name("external-dns-4266b46f-6e12-4383-943a-1dff6b37826d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ad212fc-1d4f-4b29-8673-c28d5f4e1980, kind: Service { id: 50be0e3a-9e97-45f3-9749-f7daddfbf5a4 }, name: Name("external-dns-50be0e3a-9e97-45f3-9749-f7daddfbf5a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
36802025-01-11T05:33:41.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36812025-01-11T05:33:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36822025-01-11T05:33:41.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36832025-01-11T05:33:41.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
36842025-01-11T05:33:41.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36852025-01-11T05:33:41.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36862025-01-11T05:33:41.061ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
36872025-01-11T05:33:41.061ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4d89a779-1fc1-4488-b830-819ec303eab4, kind: Service { id: 4266b46f-6e12-4383-943a-1dff6b37826d }, name: Name("external-dns-4266b46f-6e12-4383-943a-1dff6b37826d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ad212fc-1d4f-4b29-8673-c28d5f4e1980, kind: Service { id: 50be0e3a-9e97-45f3-9749-f7daddfbf5a4 }, name: Name("external-dns-50be0e3a-9e97-45f3-9749-f7daddfbf5a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3da168c4-8069-45d6-a96c-9bd6e5b1cbe0, kind: Service { id: 41bd7929-21b3-4420-bdfb-4d377eca1275 }, name: Name("nexus-41bd7929-21b3-4420-bdfb-4d377eca1275"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a400d6b-d9c4-4d4f-9a93-9d358fd2213c, kind: Service { id: c65b59c5-6763-4b24-9975-b340540b3788 }, name: Name("nexus-c65b59c5-6763-4b24-9975-b340540b3788"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f2934fe9-7f56-4391-9cbd-73ed0873ef74, kind: Service { id: aa9e7449-5e0d-48f2-bc5e-e67a9910d88d }, name: Name("nexus-aa9e7449-5e0d-48f2-bc5e-e67a9910d88d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
36882025-01-11T05:33:41.061ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
36892025-01-11T05:33:41.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36902025-01-11T05:33:41.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36912025-01-11T05:33:41.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36922025-01-11T05:33:41.126ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1fde999-cb18-4c62-9eed-b8ae4063fe4a", "content-length": "691", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
36932025-01-11T05:33:41.126ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36942025-01-11T05:33:41.126ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36952025-01-11T05:33:41.126ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36962025-01-11T05:33:41.128ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 525.479714ms iteration = 21 status = {}
36972025-01-11T05:33:41.128ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
36982025-01-11T05:33:41.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36992025-01-11T05:33:41.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37002025-01-11T05:33:41.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37012025-01-11T05:33:41.139ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "76b2e8d5-184f-4c8c-9a17-4f6d1a70899c", "content-length": "134", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
37022025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37032025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
37042025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37052025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37062025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37072025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37082025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37092025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37102025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37112025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37122025-01-11T05:33:41.139ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
37132025-01-11T05:33:41.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37142025-01-11T05:33:41.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37152025-01-11T05:33:41.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37162025-01-11T05:33:41.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf572c13-3c06-400c-8625-87feb3a59825", "content-length": "2", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
37172025-01-11T05:33:41.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37182025-01-11T05:33:41.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff3dcdb3-cc73-4498-bbd4-8c349ee8031c", "content-length": "52", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
37192025-01-11T05:33:41.142ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
37202025-01-11T05:33:41.142ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37212025-01-11T05:33:41.150ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
37222025-01-11T05:33:41.150ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
37232025-01-11T05:33:41.236ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, time_created: 2025-01-11T05:24:26.125273Z, time_modified: 2025-01-11T05:24:26.125273Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
37242025-01-11T05:33:41.236ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
37252025-01-11T05:33:41.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37262025-01-11T05:33:41.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37272025-01-11T05:33:41.238ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37282025-01-11T05:33:41.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37292025-01-11T05:33:41.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37302025-01-11T05:33:41.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c4e46c24-4e23-4f66-a917-f1609b45f192", "date": "Sat, 11 Jan 2025 05:33:40 GMT"} })
37312025-01-11T05:33:41.242ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
37322025-01-11T05:33:41.242ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37332025-01-11T05:33:41.242ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2921547-463a-4f51-b7e5-e13c21492e8a", "content-length": "682", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
37342025-01-11T05:33:41.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37352025-01-11T05:33:41.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37362025-01-11T05:33:41.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
37372025-01-11T05:33:41.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37382025-01-11T05:33:41.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37392025-01-11T05:33:41.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37402025-01-11T05:33:41.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37412025-01-11T05:33:41.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37422025-01-11T05:33:41.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37432025-01-11T05:33:41.260ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 657.191846ms iteration = 21 status = {}
37442025-01-11T05:33:41.275ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37452025-01-11T05:33:41.277ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a3e72a35-33ad-4d0c-8186-e4ae85a8ea25", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
37462025-01-11T05:33:41.278ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
37472025-01-11T05:33:41.278ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 676.056239ms
37482025-01-11T05:33:41.278ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 676.067099ms iteration = 3 status = {}
37492025-01-11T05:33:41.423ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4442ed48-f1e7-4c27-b967-5637ff953cea", "content-length": "30796", "date": "Sat, 11 Jan 2025 05:33:41 GMT"} })
37502025-01-11T05:33:41.425ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
37512025-01-11T05:33:41.425ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
37522025-01-11T05:33:41.425ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
37532025-01-11T05:33:41.427ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37542025-01-11T05:33:41.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37552025-01-11T05:33:41.429ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37562025-01-11T05:33:41.431ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
37572025-01-11T05:33:41.431ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37582025-01-11T05:33:41.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37592025-01-11T05:33:41.627ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 522548aa-7980-4927-83d8-7669a120f8df file = nexus/db-queries/src/db/datastore/inventory.rs:1010
37602025-01-11T05:33:41.627ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 522548aa-7980-4927-83d8-7669a120f8df time_started = 2025-01-11 05:33:41.034408 UTC
37612025-01-11T05:33:41.627ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.025198182s iteration = 3 status = {"collection_id":"522548aa-7980-4927-83d8-7669a120f8df","time_done":"2025-01-11 05:33:41.425848 UTC","time_started":"2025-01-11 05:33:41.034408 UTC"}
37622025-01-11T05:33:41.627ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
37632025-01-11T05:33:41.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37642025-01-11T05:33:41.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37652025-01-11T05:33:41.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37662025-01-11T05:33:41.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37672025-01-11T05:33:41.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37682025-01-11T05:33:41.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37692025-01-11T05:33:41.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37702025-01-11T05:33:41.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37712025-01-11T05:33:41.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37722025-01-11T05:33:41.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37732025-01-11T05:33:41.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37742025-01-11T05:33:41.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37752025-01-11T05:33:41.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b610c74b-7e2b-4914-87f5-d0fb76a655f2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37762025-01-11T05:33:41.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b610c74b-7e2b-4914-87f5-d0fb76a655f2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37772025-01-11T05:33:41.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b610c74b-7e2b-4914-87f5-d0fb76a655f2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37782025-01-11T05:33:41.733ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.677374ms iteration = 24 status = {"physical_disks_added":0}
37792025-01-11T05:33:42.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4d49a01f-da91-44b5-989d-6665fc9ea661 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37802025-01-11T05:33:42.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4d49a01f-da91-44b5-989d-6665fc9ea661 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37812025-01-11T05:33:42.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4d49a01f-da91-44b5-989d-6665fc9ea661 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37822025-01-11T05:33:42.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2222d876-8ba5-4615-a161-52242ca7e11c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37832025-01-11T05:33:42.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2222d876-8ba5-4615-a161-52242ca7e11c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37842025-01-11T05:33:42.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2222d876-8ba5-4615-a161-52242ca7e11c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37852025-01-11T05:33:43.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4885ee29-98e0-4d9c-a7c6-484b336122a9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37862025-01-11T05:33:43.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4885ee29-98e0-4d9c-a7c6-484b336122a9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37872025-01-11T05:33:43.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4885ee29-98e0-4d9c-a7c6-484b336122a9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37882025-01-11T05:33:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = d134f378-6936-439b-9bc6-9803508204e5 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
37892025-01-11T05:33:44.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d5d6fe43-5f45-46b8-aa5e-d38db27d4383 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37902025-01-11T05:33:44.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d5d6fe43-5f45-46b8-aa5e-d38db27d4383 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37912025-01-11T05:33:44.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d5d6fe43-5f45-46b8-aa5e-d38db27d4383 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37922025-01-11T05:33:45.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f622165-a19f-47ca-8bdd-612c95ff962e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37932025-01-11T05:33:45.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f622165-a19f-47ca-8bdd-612c95ff962e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37942025-01-11T05:33:45.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8f622165-a19f-47ca-8bdd-612c95ff962e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37952025-01-11T05:33:46.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a444dbc2-8e8e-41e1-9676-3eda4125eda1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37962025-01-11T05:33:46.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a444dbc2-8e8e-41e1-9676-3eda4125eda1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37972025-01-11T05:33:46.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a444dbc2-8e8e-41e1-9676-3eda4125eda1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37982025-01-11T05:33:47.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1536bac8-c7ec-4422-a3dd-7dfe2be1a33c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
37992025-01-11T05:33:47.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1536bac8-c7ec-4422-a3dd-7dfe2be1a33c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38002025-01-11T05:33:47.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1536bac8-c7ec-4422-a3dd-7dfe2be1a33c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38012025-01-11T05:33:48.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e6ceca8-7dca-4f22-8847-998786f2e37b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38022025-01-11T05:33:48.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e6ceca8-7dca-4f22-8847-998786f2e37b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38032025-01-11T05:33:48.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0e6ceca8-7dca-4f22-8847-998786f2e37b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38042025-01-11T05:33:49.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e7649833-58a2-438d-8bb3-f03a2b753303 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38052025-01-11T05:33:49.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e7649833-58a2-438d-8bb3-f03a2b753303 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38062025-01-11T05:33:49.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e7649833-58a2-438d-8bb3-f03a2b753303 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38072025-01-11T05:33:50.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
38082025-01-11T05:33:50.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38092025-01-11T05:33:50.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
38102025-01-11T05:33:50.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38112025-01-11T05:33:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38122025-01-11T05:33:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38132025-01-11T05:33:50.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38142025-01-11T05:33:50.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38152025-01-11T05:33:50.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38162025-01-11T05:33:50.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38172025-01-11T05:33:50.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38182025-01-11T05:33:50.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38192025-01-11T05:33:50.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38202025-01-11T05:33:50.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
38212025-01-11T05:33:50.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38222025-01-11T05:33:50.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38232025-01-11T05:33:50.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
38242025-01-11T05:33:50.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.87323ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
38252025-01-11T05:33:50.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38262025-01-11T05:33:50.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38272025-01-11T05:33:50.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.182099ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38282025-01-11T05:33:50.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d3e59127-87e6-4ea4-9df3-2769ee367de6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38292025-01-11T05:33:50.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d3e59127-87e6-4ea4-9df3-2769ee367de6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38302025-01-11T05:33:50.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d3e59127-87e6-4ea4-9df3-2769ee367de6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38312025-01-11T05:33:51.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 015f3359-79d1-4876-a7f3-fccf25bd859d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38322025-01-11T05:33:51.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 015f3359-79d1-4876-a7f3-fccf25bd859d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38332025-01-11T05:33:51.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 015f3359-79d1-4876-a7f3-fccf25bd859d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38342025-01-11T05:33:52.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ae4b36a8-e7f9-4086-864f-91207210b4b0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38352025-01-11T05:33:52.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ae4b36a8-e7f9-4086-864f-91207210b4b0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38362025-01-11T05:33:52.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ae4b36a8-e7f9-4086-864f-91207210b4b0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38372025-01-11T05:33:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = bc4d389b-800f-4ecb-9fd1-1eedff18275a response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
38382025-01-11T05:33:53.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8c14508e-3194-41db-aa18-ff5439131055 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38392025-01-11T05:33:53.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8c14508e-3194-41db-aa18-ff5439131055 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38402025-01-11T05:33:53.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8c14508e-3194-41db-aa18-ff5439131055 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38412025-01-11T05:33:55.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4fceddea-1398-4326-83ac-94ba48663a95 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38422025-01-11T05:33:55.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4fceddea-1398-4326-83ac-94ba48663a95 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38432025-01-11T05:33:55.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4fceddea-1398-4326-83ac-94ba48663a95 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38442025-01-11T05:33:56.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1ed36b11-66b9-45da-9875-6911a4e083e7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38452025-01-11T05:33:56.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1ed36b11-66b9-45da-9875-6911a4e083e7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38462025-01-11T05:33:56.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1ed36b11-66b9-45da-9875-6911a4e083e7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38472025-01-11T05:33:57.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cfb09e9d-5ef1-4c15-8356-9d1175af06ce roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38482025-01-11T05:33:57.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cfb09e9d-5ef1-4c15-8356-9d1175af06ce resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38492025-01-11T05:33:57.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cfb09e9d-5ef1-4c15-8356-9d1175af06ce response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38502025-01-11T05:33:58.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 284c51d8-d67b-4340-a449-0160674d714c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38512025-01-11T05:33:58.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 284c51d8-d67b-4340-a449-0160674d714c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38522025-01-11T05:33:58.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 284c51d8-d67b-4340-a449-0160674d714c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38532025-01-11T05:33:59.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 24f780c2-6725-4196-bf23-036c85740b9f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38542025-01-11T05:33:59.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 24f780c2-6725-4196-bf23-036c85740b9f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38552025-01-11T05:33:59.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 24f780c2-6725-4196-bf23-036c85740b9f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38562025-01-11T05:34:00.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 039e65f8-46f7-4a86-8d6f-2675279dcec2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38572025-01-11T05:34:00.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 039e65f8-46f7-4a86-8d6f-2675279dcec2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38582025-01-11T05:34:00.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 039e65f8-46f7-4a86-8d6f-2675279dcec2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38592025-01-11T05:34:00.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
38602025-01-11T05:34:00.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
38612025-01-11T05:34:00.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38622025-01-11T05:34:00.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38632025-01-11T05:34:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38642025-01-11T05:34:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38652025-01-11T05:34:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38662025-01-11T05:34:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38672025-01-11T05:34:00.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38682025-01-11T05:34:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38692025-01-11T05:34:00.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702025-01-11T05:34:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38712025-01-11T05:34:00.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38722025-01-11T05:34:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
38732025-01-11T05:34:00.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38742025-01-11T05:34:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38752025-01-11T05:34:00.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
38762025-01-11T05:34:00.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.201051ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
38772025-01-11T05:34:00.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38782025-01-11T05:34:00.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38792025-01-11T05:34:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.558927ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38802025-01-11T05:34:01.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a974f5cd-00f6-4add-b54a-21d56f50d82e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38812025-01-11T05:34:01.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a974f5cd-00f6-4add-b54a-21d56f50d82e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38822025-01-11T05:34:01.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a974f5cd-00f6-4add-b54a-21d56f50d82e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38832025-01-11T05:34:02.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ece2f28d-fe26-4b5b-9f3e-32cc129c9d23 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38842025-01-11T05:34:02.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ece2f28d-fe26-4b5b-9f3e-32cc129c9d23 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38852025-01-11T05:34:02.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ece2f28d-fe26-4b5b-9f3e-32cc129c9d23 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38862025-01-11T05:34:03.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 57ee75d1-8dc0-484f-be57-ba20d9635eb3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38872025-01-11T05:34:03.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 57ee75d1-8dc0-484f-be57-ba20d9635eb3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38882025-01-11T05:34:03.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 57ee75d1-8dc0-484f-be57-ba20d9635eb3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38892025-01-11T05:34:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 638 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = cecba5f1-5130-440c-8932-e8ca65e40ed6 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
38902025-01-11T05:34:04.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2457d80e-7eca-4481-82fe-9b8ddfb19748 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38912025-01-11T05:34:04.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2457d80e-7eca-4481-82fe-9b8ddfb19748 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38922025-01-11T05:34:04.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2457d80e-7eca-4481-82fe-9b8ddfb19748 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38932025-01-11T05:34:05.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9730237d-785c-4605-a5d5-bd51a606da8e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38942025-01-11T05:34:05.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9730237d-785c-4605-a5d5-bd51a606da8e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38952025-01-11T05:34:05.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9730237d-785c-4605-a5d5-bd51a606da8e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38962025-01-11T05:34:06.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 269d3aa1-086d-47bc-96b1-ee2a5b1f9058 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38972025-01-11T05:34:06.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 269d3aa1-086d-47bc-96b1-ee2a5b1f9058 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38982025-01-11T05:34:06.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 269d3aa1-086d-47bc-96b1-ee2a5b1f9058 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
38992025-01-11T05:34:07.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 187f04c8-00f6-40e5-9061-fb648c85c1ab roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39002025-01-11T05:34:07.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 187f04c8-00f6-40e5-9061-fb648c85c1ab resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39012025-01-11T05:34:07.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 187f04c8-00f6-40e5-9061-fb648c85c1ab response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39022025-01-11T05:34:08.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 42ff3568-5997-4895-b7b4-d8c759f7f811 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39032025-01-11T05:34:08.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 42ff3568-5997-4895-b7b4-d8c759f7f811 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39042025-01-11T05:34:08.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 42ff3568-5997-4895-b7b4-d8c759f7f811 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39052025-01-11T05:34:08.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8b4dffa3-ba3a-493d-a5a4-06e327bfcb4a roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
39062025-01-11T05:34:08.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8b4dffa3-ba3a-493d-a5a4-06e327bfcb4a resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
39072025-01-11T05:34:08.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8b4dffa3-ba3a-493d-a5a4-06e327bfcb4a response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
39082025-01-11T05:34:08.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 1c0c7740-8db6-4f17-8430-c3f9e4ed44f8 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
39092025-01-11T05:34:08.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 1c0c7740-8db6-4f17-8430-c3f9e4ed44f8 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
39102025-01-11T05:34:08.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 1c0c7740-8db6-4f17-8430-c3f9e4ed44f8 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
39112025-01-11T05:34:09.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aaf28745-eded-45ec-9aaf-0c3b1b09da10 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39122025-01-11T05:34:09.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aaf28745-eded-45ec-9aaf-0c3b1b09da10 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39132025-01-11T05:34:09.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aaf28745-eded-45ec-9aaf-0c3b1b09da10 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39142025-01-11T05:34:10.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dba0c00c-d663-4a87-b950-cac31104343a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39152025-01-11T05:34:10.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dba0c00c-d663-4a87-b950-cac31104343a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39162025-01-11T05:34:10.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dba0c00c-d663-4a87-b950-cac31104343a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
39172025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
39182025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
39192025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39202025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39212025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
39222025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
39232025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39242025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39252025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
39262025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39272025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
39282025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39292025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
39302025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39312025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
39322025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
39332025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39342025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39352025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
39362025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39372025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
39382025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39392025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
39402025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
39412025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39422025-01-11T05:34:10.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39432025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
39442025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39452025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
39462025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39472025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39482025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
39492025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39502025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39512025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39522025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39532025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39542025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39552025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39562025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39572025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39582025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39592025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39602025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39612025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39622025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39632025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39642025-01-11T05:34:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39652025-01-11T05:34:10.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
39662025-01-11T05:34:10.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39672025-01-11T05:34:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39682025-01-11T05:34:10.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692025-01-11T05:34:10.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702025-01-11T05:34:10.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.517717ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39712025-01-11T05:34:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39722025-01-11T05:34:10.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39732025-01-11T05:34:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39742025-01-11T05:34:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39752025-01-11T05:34:10.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39762025-01-11T05:34:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39772025-01-11T05:34:10.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39782025-01-11T05:34:10.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39792025-01-11T05:34:10.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39802025-01-11T05:34:10.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39812025-01-11T05:34:10.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39822025-01-11T05:34:10.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39832025-01-11T05:34:10.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39842025-01-11T05:34:10.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39852025-01-11T05:34:10.617ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1590, tv_nsec: 173842097 } })
39862025-01-11T05:34:10.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39872025-01-11T05:34:10.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882025-01-11T05:34:10.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892025-01-11T05:34:10.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1590, tv_nsec: 176386253 } })
39902025-01-11T05:34:10.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39912025-01-11T05:34:10.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39922025-01-11T05:34:10.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39932025-01-11T05:34:10.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39942025-01-11T05:34:10.622ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39952025-01-11T05:34:10.622ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39962025-01-11T05:34:10.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39972025-01-11T05:34:10.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39982025-01-11T05:34:10.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39992025-01-11T05:34:10.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40002025-01-11T05:34:10.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40012025-01-11T05:34:10.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40022025-01-11T05:34:10.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40032025-01-11T05:34:10.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40042025-01-11T05:34:10.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40052025-01-11T05:34:10.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40062025-01-11T05:34:10.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40072025-01-11T05:34:10.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40082025-01-11T05:34:10.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40092025-01-11T05:34:10.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 25.814056ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40102025-01-11T05:34:10.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40112025-01-11T05:34:10.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122025-01-11T05:34:10.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40132025-01-11T05:34:10.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1590, tv_nsec: 186599526 } })
40142025-01-11T05:34:10.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
40152025-01-11T05:34:10.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40162025-01-11T05:34:10.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40172025-01-11T05:34:10.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40182025-01-11T05:34:10.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40192025-01-11T05:34:10.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
40202025-01-11T05:34:10.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40212025-01-11T05:34:10.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40222025-01-11T05:34:10.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.321454ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
40232025-01-11T05:34:10.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40242025-01-11T05:34:10.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40252025-01-11T05:34:10.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
40262025-01-11T05:34:10.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.901808ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
40272025-01-11T05:34:10.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40282025-01-11T05:34:10.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40292025-01-11T05:34:10.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40302025-01-11T05:34:10.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40312025-01-11T05:34:10.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40322025-01-11T05:34:10.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40332025-01-11T05:34:10.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.688751ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
40342025-01-11T05:34:10.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40352025-01-11T05:34:10.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40362025-01-11T05:34:10.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40372025-01-11T05:34:10.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40382025-01-11T05:34:10.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40392025-01-11T05:34:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
40402025-01-11T05:34:10.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40412025-01-11T05:34:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40422025-01-11T05:34:10.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40432025-01-11T05:34:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40442025-01-11T05:34:10.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40452025-01-11T05:34:10.668ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.012095ms iteration = 22 status = 0
40462025-01-11T05:34:10.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40472025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40482025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40492025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40502025-01-11T05:34:10.670ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40512025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40522025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40532025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40542025-01-11T05:34:10.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40552025-01-11T05:34:10.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40562025-01-11T05:34:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40572025-01-11T05:34:10.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.070842ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40582025-01-11T05:34:10.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40592025-01-11T05:34:10.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40602025-01-11T05:34:10.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40612025-01-11T05:34:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40622025-01-11T05:34:10.680ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 78.705053ms iteration = 25 status = {"physical_disks_added":0}
40632025-01-11T05:34:10.683ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40642025-01-11T05:34:10.684ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.564235ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40652025-01-11T05:34:10.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.370617ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40662025-01-11T05:34:10.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.201765ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40672025-01-11T05:34:10.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40682025-01-11T05:34:10.694ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40692025-01-11T05:34:10.694ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c8edff4-0eff-4eec-8591-c760cc762b1e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
40702025-01-11T05:34:10.694ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40712025-01-11T05:34:10.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40722025-01-11T05:34:10.702ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40732025-01-11T05:34:10.702ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40742025-01-11T05:34:10.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.703172ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40752025-01-11T05:34:10.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40762025-01-11T05:34:10.703ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40772025-01-11T05:34:10.703ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d94a2a8-aef4-4aa7-90e7-90dea09060d6", "content-length": "26", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
40782025-01-11T05:34:10.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40792025-01-11T05:34:10.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40802025-01-11T05:34:10.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
40812025-01-11T05:34:10.707ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40822025-01-11T05:34:10.707ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e465d863-8be7-452c-b10d-32846b040104", "content-length": "26", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
40832025-01-11T05:34:10.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40842025-01-11T05:34:10.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
40852025-01-11T05:34:10.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40862025-01-11T05:34:10.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7fe8e05-b41f-484f-aef6-0e07d1aeef77", "content-length": "691", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
40872025-01-11T05:34:10.888ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40882025-01-11T05:34:10.888ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40892025-01-11T05:34:10.888ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40902025-01-11T05:34:10.889ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.167166ms iteration = 22 status = {}
40912025-01-11T05:34:10.942ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40922025-01-11T05:34:10.942ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8669220-f8e0-4a8a-97cc-9beae642bebc", "content-length": "1", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
40932025-01-11T05:34:10.943ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40942025-01-11T05:34:10.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40952025-01-11T05:34:10.945ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.585352ms iteration = 22 status = null
40962025-01-11T05:34:10.953ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 351.543425ms iteration = 22 status = {}
40972025-01-11T05:34:10.967ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40982025-01-11T05:34:10.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40992025-01-11T05:34:10.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "05323160-028b-46ac-8fb1-554e3874e9b0", "content-length": "372", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41002025-01-11T05:34:10.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41012025-01-11T05:34:10.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41022025-01-11T05:34:11.009ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41032025-01-11T05:34:11.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41042025-01-11T05:34:11.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "15b299ff-caaf-4ab4-b449-3671bc9dc3d0", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41052025-01-11T05:34:11.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41062025-01-11T05:34:11.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41072025-01-11T05:34:11.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41082025-01-11T05:34:11.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41092025-01-11T05:34:11.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41102025-01-11T05:34:11.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41112025-01-11T05:34:11.018ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41122025-01-11T05:34:11.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41132025-01-11T05:34:11.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f8d97482-8626-4684-9027-7f77f5f2152a", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41142025-01-11T05:34:11.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 418.146953ms iteration = 22 status = {}
41152025-01-11T05:34:11.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41162025-01-11T05:34:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41172025-01-11T05:34:11.030ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
41182025-01-11T05:34:11.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41192025-01-11T05:34:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41202025-01-11T05:34:11.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41212025-01-11T05:34:11.041ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9bc06ec-f5ae-4ba7-8d6d-127f3523d303", "content-length": "134", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41222025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41232025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
41242025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41252025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41262025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41272025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41282025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41292025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41302025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41312025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41322025-01-11T05:34:11.041ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
41332025-01-11T05:34:11.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41342025-01-11T05:34:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41352025-01-11T05:34:11.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41362025-01-11T05:34:11.044ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "73e64dff-7dc4-4fea-87f6-2d83bedfb62f", "content-length": "2", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41372025-01-11T05:34:11.044ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41382025-01-11T05:34:11.044ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "24e26466-6216-48d5-b907-7183877415c2", "content-length": "52", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41392025-01-11T05:34:11.044ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
41402025-01-11T05:34:11.044ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41412025-01-11T05:34:11.146ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cd86aa30-ef17-4f94-89da-a8da5dfe0476", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41422025-01-11T05:34:11.146ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
41432025-01-11T05:34:11.146ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41442025-01-11T05:34:11.147ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6e7cee4-b996-47dc-8c62-438101ed3672", "content-length": "682", "date": "Sat, 11 Jan 2025 05:34:10 GMT"} })
41452025-01-11T05:34:11.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41462025-01-11T05:34:11.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41472025-01-11T05:34:11.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41482025-01-11T05:34:11.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41492025-01-11T05:34:11.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41502025-01-11T05:34:11.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41512025-01-11T05:34:11.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41522025-01-11T05:34:11.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41532025-01-11T05:34:11.161ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 559.556319ms iteration = 22 status = {}
41542025-01-11T05:34:11.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 74c46439-362a-4c1e-b4e3-bcaed2ff0c80 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41552025-01-11T05:34:11.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 74c46439-362a-4c1e-b4e3-bcaed2ff0c80 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41562025-01-11T05:34:11.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 74c46439-362a-4c1e-b4e3-bcaed2ff0c80 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41572025-01-11T05:34:12.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = efec4b95-206e-4825-b530-b7a7862a73a3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41582025-01-11T05:34:12.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = efec4b95-206e-4825-b530-b7a7862a73a3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41592025-01-11T05:34:12.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = efec4b95-206e-4825-b530-b7a7862a73a3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41602025-01-11T05:34:12.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 801446f9-128d-4144-9616-df6fd6afff06 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41612025-01-11T05:34:12.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 801446f9-128d-4144-9616-df6fd6afff06 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41622025-01-11T05:34:12.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 801446f9-128d-4144-9616-df6fd6afff06 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41632025-01-11T05:34:13.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4bf8d305-9010-458e-ab81-4823494ea796 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41642025-01-11T05:34:13.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4bf8d305-9010-458e-ab81-4823494ea796 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41652025-01-11T05:34:13.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4bf8d305-9010-458e-ab81-4823494ea796 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41662025-01-11T05:34:13.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 25c999bb-b975-418d-9a8b-fd5d27b5a31f response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
41672025-01-11T05:34:14.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 66e20e18-aaf4-4044-94ea-b679772bf64b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41682025-01-11T05:34:14.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 66e20e18-aaf4-4044-94ea-b679772bf64b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41692025-01-11T05:34:14.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 66e20e18-aaf4-4044-94ea-b679772bf64b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41702025-01-11T05:34:15.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4ffd8db4-49eb-40a7-90cb-d9e6a9272139 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41712025-01-11T05:34:15.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4ffd8db4-49eb-40a7-90cb-d9e6a9272139 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41722025-01-11T05:34:15.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4ffd8db4-49eb-40a7-90cb-d9e6a9272139 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41732025-01-11T05:34:16.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 518c7561-e0d8-484f-ac70-978871036ecf roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41742025-01-11T05:34:16.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 518c7561-e0d8-484f-ac70-978871036ecf resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41752025-01-11T05:34:16.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 518c7561-e0d8-484f-ac70-978871036ecf response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41762025-01-11T05:34:17.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cd45bae2-2bf7-46e3-95d0-c31d21a398ce roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41772025-01-11T05:34:17.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cd45bae2-2bf7-46e3-95d0-c31d21a398ce resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41782025-01-11T05:34:17.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cd45bae2-2bf7-46e3-95d0-c31d21a398ce response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41792025-01-11T05:34:18.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c2ffb8c0-db8a-4bec-925c-9b5f21532e08 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41802025-01-11T05:34:18.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c2ffb8c0-db8a-4bec-925c-9b5f21532e08 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41812025-01-11T05:34:18.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c2ffb8c0-db8a-4bec-925c-9b5f21532e08 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41822025-01-11T05:34:19.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a70c8043-6718-4297-b662-a28b716164c4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41832025-01-11T05:34:19.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a70c8043-6718-4297-b662-a28b716164c4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41842025-01-11T05:34:19.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a70c8043-6718-4297-b662-a28b716164c4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41852025-01-11T05:34:20.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a60729e-d7c1-4296-ab98-334a74e298ba roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41862025-01-11T05:34:20.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a60729e-d7c1-4296-ab98-334a74e298ba resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41872025-01-11T05:34:20.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a60729e-d7c1-4296-ab98-334a74e298ba response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
41882025-01-11T05:34:20.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
41892025-01-11T05:34:20.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
41902025-01-11T05:34:20.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41912025-01-11T05:34:20.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41922025-01-11T05:34:20.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41932025-01-11T05:34:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41942025-01-11T05:34:20.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41952025-01-11T05:34:20.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41962025-01-11T05:34:20.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41972025-01-11T05:34:20.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41982025-01-11T05:34:20.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41992025-01-11T05:34:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42002025-01-11T05:34:20.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42012025-01-11T05:34:20.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
42022025-01-11T05:34:20.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42032025-01-11T05:34:20.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42042025-01-11T05:34:20.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
42052025-01-11T05:34:20.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.776948ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
42062025-01-11T05:34:20.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42072025-01-11T05:34:20.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42082025-01-11T05:34:20.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.45236ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42092025-01-11T05:34:21.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c6022be9-61c2-4349-9fb7-1ce8dbe1e694 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42102025-01-11T05:34:21.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c6022be9-61c2-4349-9fb7-1ce8dbe1e694 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42112025-01-11T05:34:21.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c6022be9-61c2-4349-9fb7-1ce8dbe1e694 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42122025-01-11T05:34:22.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c6469f66-5aab-4848-94f1-a1c46dbd6626 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42132025-01-11T05:34:22.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c6469f66-5aab-4848-94f1-a1c46dbd6626 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42142025-01-11T05:34:22.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c6469f66-5aab-4848-94f1-a1c46dbd6626 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42152025-01-11T05:34:23.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 070a5ece-6255-4a94-915c-7e8b37eed4f3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42162025-01-11T05:34:23.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 070a5ece-6255-4a94-915c-7e8b37eed4f3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42172025-01-11T05:34:23.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 070a5ece-6255-4a94-915c-7e8b37eed4f3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42182025-01-11T05:34:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = a58a79eb-2779-4310-92b4-40aa058a485a response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
42192025-01-11T05:34:24.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = baea94cc-41ba-4008-9bf2-2bcac8c535a5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42202025-01-11T05:34:24.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = baea94cc-41ba-4008-9bf2-2bcac8c535a5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42212025-01-11T05:34:24.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = baea94cc-41ba-4008-9bf2-2bcac8c535a5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42222025-01-11T05:34:25.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9edcfe00-f982-45f5-8cd1-8a5690abd587 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42232025-01-11T05:34:25.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9edcfe00-f982-45f5-8cd1-8a5690abd587 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42242025-01-11T05:34:25.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9edcfe00-f982-45f5-8cd1-8a5690abd587 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42252025-01-11T05:34:26.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5abb87a1-504d-4c6f-af23-59eba3bb7505 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42262025-01-11T05:34:26.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5abb87a1-504d-4c6f-af23-59eba3bb7505 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42272025-01-11T05:34:26.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5abb87a1-504d-4c6f-af23-59eba3bb7505 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42282025-01-11T05:34:27.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3b578ed4-8393-4b33-bd81-4ee1a173dd29 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42292025-01-11T05:34:27.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3b578ed4-8393-4b33-bd81-4ee1a173dd29 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42302025-01-11T05:34:27.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3b578ed4-8393-4b33-bd81-4ee1a173dd29 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42312025-01-11T05:34:28.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bdbfe99c-d7b9-4a12-ada0-aa578d3a1438 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42322025-01-11T05:34:28.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bdbfe99c-d7b9-4a12-ada0-aa578d3a1438 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42332025-01-11T05:34:28.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bdbfe99c-d7b9-4a12-ada0-aa578d3a1438 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42342025-01-11T05:34:29.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d76ba180-06a9-4c11-9f01-bae9946cd00b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42352025-01-11T05:34:29.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d76ba180-06a9-4c11-9f01-bae9946cd00b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42362025-01-11T05:34:29.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d76ba180-06a9-4c11-9f01-bae9946cd00b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42372025-01-11T05:34:30.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
42382025-01-11T05:34:30.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
42392025-01-11T05:34:30.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42402025-01-11T05:34:30.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42412025-01-11T05:34:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42422025-01-11T05:34:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42432025-01-11T05:34:30.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42442025-01-11T05:34:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42452025-01-11T05:34:30.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42462025-01-11T05:34:30.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.805344ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42472025-01-11T05:34:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42482025-01-11T05:34:30.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42492025-01-11T05:34:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42502025-01-11T05:34:30.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42512025-01-11T05:34:30.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42522025-01-11T05:34:30.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42532025-01-11T05:34:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
42542025-01-11T05:34:30.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42552025-01-11T05:34:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42562025-01-11T05:34:30.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
42572025-01-11T05:34:30.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.791529ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
42582025-01-11T05:34:30.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a64e5ea7-f8d6-41e8-b17d-339eeb1b0223 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42592025-01-11T05:34:30.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a64e5ea7-f8d6-41e8-b17d-339eeb1b0223 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42602025-01-11T05:34:30.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a64e5ea7-f8d6-41e8-b17d-339eeb1b0223 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42612025-01-11T05:34:31.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 94b56fab-8386-463e-8f48-ca62122d2680 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42622025-01-11T05:34:31.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 94b56fab-8386-463e-8f48-ca62122d2680 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42632025-01-11T05:34:31.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 94b56fab-8386-463e-8f48-ca62122d2680 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42642025-01-11T05:34:32.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fde4f322-214e-44fb-b8b4-cdcf7f61361c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42652025-01-11T05:34:32.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fde4f322-214e-44fb-b8b4-cdcf7f61361c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42662025-01-11T05:34:32.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fde4f322-214e-44fb-b8b4-cdcf7f61361c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42672025-01-11T05:34:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 814 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 142f708d-226c-4920-81b8-a78fc64cd5e8 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
42682025-01-11T05:34:33.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e3d16c0f-a2c4-40db-87ba-c27af64a6f4c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42692025-01-11T05:34:33.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e3d16c0f-a2c4-40db-87ba-c27af64a6f4c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42702025-01-11T05:34:33.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e3d16c0f-a2c4-40db-87ba-c27af64a6f4c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42712025-01-11T05:34:34.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 362ce616-aae9-4635-8825-f541d1c780c6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42722025-01-11T05:34:34.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 362ce616-aae9-4635-8825-f541d1c780c6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42732025-01-11T05:34:34.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 362ce616-aae9-4635-8825-f541d1c780c6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42742025-01-11T05:34:35.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e08b1e9c-2cb7-444f-bb36-969b92e02f46 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42752025-01-11T05:34:35.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e08b1e9c-2cb7-444f-bb36-969b92e02f46 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42762025-01-11T05:34:35.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e08b1e9c-2cb7-444f-bb36-969b92e02f46 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42772025-01-11T05:34:36.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a2ea6668-a2e6-4ff7-8a1c-b42e2f52215a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42782025-01-11T05:34:36.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a2ea6668-a2e6-4ff7-8a1c-b42e2f52215a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42792025-01-11T05:34:36.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a2ea6668-a2e6-4ff7-8a1c-b42e2f52215a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42802025-01-11T05:34:37.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fe62a5dd-7a40-4bc6-a529-35d059e6a62b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42812025-01-11T05:34:37.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fe62a5dd-7a40-4bc6-a529-35d059e6a62b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42822025-01-11T05:34:37.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fe62a5dd-7a40-4bc6-a529-35d059e6a62b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42832025-01-11T05:34:38.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0722c943-a968-4e62-b357-c5001ead1e01 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42842025-01-11T05:34:38.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0722c943-a968-4e62-b357-c5001ead1e01 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42852025-01-11T05:34:38.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0722c943-a968-4e62-b357-c5001ead1e01 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42862025-01-11T05:34:39.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dd09433b-7442-4c6a-9d0a-b6952da3adc9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42872025-01-11T05:34:39.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dd09433b-7442-4c6a-9d0a-b6952da3adc9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42882025-01-11T05:34:39.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dd09433b-7442-4c6a-9d0a-b6952da3adc9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
42892025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
42902025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42912025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
42922025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
42932025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
42942025-01-11T05:34:40.601ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42952025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42962025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42972025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
42982025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42992025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43002025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
43012025-01-11T05:34:40.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
43022025-01-11T05:34:40.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
43032025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43042025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
43052025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.321\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
43062025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43072025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
43082025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
43092025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43102025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
43112025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43122025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43132025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
43142025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43152025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
43162025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43172025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
43182025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43192025-01-11T05:34:40.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:24:40.601962402 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43202025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43212025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
43222025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
43232025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
43242025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43252025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
43262025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43272025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
43282025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43292025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
43302025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
43312025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43322025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43332025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
43342025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43352025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
43362025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43372025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
43382025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
43392025-01-11T05:34:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43402025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43412025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43422025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
43432025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
43442025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43452025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
43462025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43472025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
43482025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43492025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43502025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43512025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43522025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43532025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43542025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43552025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43562025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43572025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43582025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43592025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43602025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43612025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
43622025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43632025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43642025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43652025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43662025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43672025-01-11T05:34:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1620, tv_nsec: 158860755 } })
43682025-01-11T05:34:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1620, tv_nsec: 158884015 } })
43692025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43702025-01-11T05:34:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43712025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43722025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43732025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43742025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43752025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43762025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43772025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43782025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.616845ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43792025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43802025-01-11T05:34:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.548453ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43812025-01-11T05:34:40.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43822025-01-11T05:34:40.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43832025-01-11T05:34:40.605ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.339553ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
43842025-01-11T05:34:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.12368ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43852025-01-11T05:34:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43862025-01-11T05:34:40.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43872025-01-11T05:34:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43882025-01-11T05:34:40.607ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43892025-01-11T05:34:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43902025-01-11T05:34:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43912025-01-11T05:34:40.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43922025-01-11T05:34:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43932025-01-11T05:34:40.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1620, tv_nsec: 166326049 } })
43942025-01-11T05:34:40.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43952025-01-11T05:34:40.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43962025-01-11T05:34:40.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43972025-01-11T05:34:40.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43982025-01-11T05:34:40.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992025-01-11T05:34:40.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44002025-01-11T05:34:40.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44012025-01-11T05:34:40.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44022025-01-11T05:34:40.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44032025-01-11T05:34:40.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44042025-01-11T05:34:40.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44052025-01-11T05:34:40.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44062025-01-11T05:34:40.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44072025-01-11T05:34:40.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082025-01-11T05:34:40.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44092025-01-11T05:34:40.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44102025-01-11T05:34:40.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44112025-01-11T05:34:40.620ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:24:40.601962402 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44122025-01-11T05:34:40.621ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.023386ms iteration = 12 status = {"expiration":"2025-01-11T05:24:40.601962402Z","pruned":[]}
44132025-01-11T05:34:40.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44142025-01-11T05:34:40.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1620, tv_nsec: 177316279 } })
44152025-01-11T05:34:40.621ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44162025-01-11T05:34:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44172025-01-11T05:34:40.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44182025-01-11T05:34:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44192025-01-11T05:34:40.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.049009ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44202025-01-11T05:34:40.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212025-01-11T05:34:40.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44222025-01-11T05:34:40.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44232025-01-11T05:34:40.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44242025-01-11T05:34:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44252025-01-11T05:34:40.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44262025-01-11T05:34:40.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44272025-01-11T05:34:40.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44282025-01-11T05:34:40.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44292025-01-11T05:34:40.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44302025-01-11T05:34:40.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44312025-01-11T05:34:40.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44322025-01-11T05:34:40.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332025-01-11T05:34:40.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342025-01-11T05:34:40.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44352025-01-11T05:34:40.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44362025-01-11T05:34:40.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44372025-01-11T05:34:40.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44382025-01-11T05:34:40.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44392025-01-11T05:34:40.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44402025-01-11T05:34:40.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44412025-01-11T05:34:40.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44422025-01-11T05:34:40.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44432025-01-11T05:34:40.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44442025-01-11T05:34:40.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44452025-01-11T05:34:40.657ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44462025-01-11T05:34:40.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44472025-01-11T05:34:40.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44482025-01-11T05:34:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44492025-01-11T05:34:40.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44502025-01-11T05:34:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44512025-01-11T05:34:40.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.908249ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
44522025-01-11T05:34:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44532025-01-11T05:34:40.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44542025-01-11T05:34:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44552025-01-11T05:34:40.663ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44562025-01-11T05:34:40.663ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44572025-01-11T05:34:40.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44582025-01-11T05:34:40.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44592025-01-11T05:34:40.663ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 61.260111ms iteration = 26 status = {"physical_disks_added":0}
44602025-01-11T05:34:40.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44612025-01-11T05:34:40.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44622025-01-11T05:34:40.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.339695ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44632025-01-11T05:34:40.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44642025-01-11T05:34:40.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44652025-01-11T05:34:40.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44662025-01-11T05:34:40.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44672025-01-11T05:34:40.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44682025-01-11T05:34:40.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44692025-01-11T05:34:40.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.999124ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
44702025-01-11T05:34:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44712025-01-11T05:34:40.674ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44722025-01-11T05:34:40.674ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.239202ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44732025-01-11T05:34:40.674ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44742025-01-11T05:34:40.674ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44752025-01-11T05:34:40.674ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.320634ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44762025-01-11T05:34:40.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44772025-01-11T05:34:40.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-01-11T05:34:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
44792025-01-11T05:34:40.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44802025-01-11T05:34:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44812025-01-11T05:34:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44822025-01-11T05:34:40.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44832025-01-11T05:34:40.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44842025-01-11T05:34:40.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44852025-01-11T05:34:40.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44862025-01-11T05:34:40.709ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44872025-01-11T05:34:40.709ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44882025-01-11T05:34:40.709ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44892025-01-11T05:34:40.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44902025-01-11T05:34:40.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44912025-01-11T05:34:40.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44922025-01-11T05:34:40.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44932025-01-11T05:34:40.740ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44942025-01-11T05:34:40.750ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44952025-01-11T05:34:40.750ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44962025-01-11T05:34:40.751ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97143c74-865e-4e21-8ee7-fb99b14f7515", "content-length": "26", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
44972025-01-11T05:34:40.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44982025-01-11T05:34:40.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44992025-01-11T05:34:40.803ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45002025-01-11T05:34:40.804ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45012025-01-11T05:34:40.804ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8959dfac-63fc-4f20-b4dd-eed7728c1fc6", "content-length": "372", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
45022025-01-11T05:34:40.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45032025-01-11T05:34:40.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45042025-01-11T05:34:40.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1620, tv_nsec: 364018936 } })
45052025-01-11T05:34:40.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45062025-01-11T05:34:40.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
45072025-01-11T05:34:40.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45082025-01-11T05:34:40.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45092025-01-11T05:34:40.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45102025-01-11T05:34:40.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45112025-01-11T05:34:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45122025-01-11T05:34:40.816ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45132025-01-11T05:34:40.816ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45142025-01-11T05:34:40.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45152025-01-11T05:34:40.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45162025-01-11T05:34:40.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45172025-01-11T05:34:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45182025-01-11T05:34:40.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45192025-01-11T05:34:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45202025-01-11T05:34:40.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
45212025-01-11T05:34:40.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 219.510695ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
45222025-01-11T05:34:40.823ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45232025-01-11T05:34:40.823ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45242025-01-11T05:34:40.823ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
45252025-01-11T05:34:40.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 221.594421ms iteration = 12 status = {"generation":1}
45262025-01-11T05:34:40.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45272025-01-11T05:34:40.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45282025-01-11T05:34:40.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45292025-01-11T05:34:40.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 235.639308ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45302025-01-11T05:34:40.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312025-01-11T05:34:40.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 236.972167ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45322025-01-11T05:34:40.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45332025-01-11T05:34:40.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45342025-01-11T05:34:40.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45352025-01-11T05:34:40.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45362025-01-11T05:34:40.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45372025-01-11T05:34:40.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45382025-01-11T05:34:40.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45392025-01-11T05:34:40.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 240.344441ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45402025-01-11T05:34:40.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
45412025-01-11T05:34:40.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45422025-01-11T05:34:40.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45432025-01-11T05:34:40.845ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45442025-01-11T05:34:40.845ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45452025-01-11T05:34:40.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45462025-01-11T05:34:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45472025-01-11T05:34:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45482025-01-11T05:34:40.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45492025-01-11T05:34:40.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45502025-01-11T05:34:40.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 243.966451ms iteration = 23 status = 0
45512025-01-11T05:34:40.866ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45522025-01-11T05:34:40.866ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45532025-01-11T05:34:40.866ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "15de7a57-efa8-4905-b741-30807d3ce6a1", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
45542025-01-11T05:34:40.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45552025-01-11T05:34:40.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45562025-01-11T05:34:40.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45572025-01-11T05:34:40.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45582025-01-11T05:34:40.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45592025-01-11T05:34:40.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45602025-01-11T05:34:40.881ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45612025-01-11T05:34:40.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45622025-01-11T05:34:40.881ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d46ad508-7fea-42a9-9789-f6a1ee3494f8", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
45632025-01-11T05:34:40.883ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 281.472172ms iteration = 23 status = {}
45642025-01-11T05:34:40.885ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45652025-01-11T05:34:40.885ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45662025-01-11T05:34:40.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 283.872945ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45672025-01-11T05:34:40.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45682025-01-11T05:34:40.886ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45692025-01-11T05:34:40.886ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dab623ab-8716-498a-93b8-1e60e2fa9d13", "content-length": "26", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
45702025-01-11T05:34:40.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45712025-01-11T05:34:40.888ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45722025-01-11T05:34:40.890ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45732025-01-11T05:34:40.890ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
45742025-01-11T05:34:40.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45752025-01-11T05:34:40.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45762025-01-11T05:34:40.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772025-01-11T05:34:40.893ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
45782025-01-11T05:34:40.893ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 291.501171ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45792025-01-11T05:34:40.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45802025-01-11T05:34:40.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45812025-01-11T05:34:40.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45822025-01-11T05:34:40.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45832025-01-11T05:34:40.896ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e456b6bb-ef0e-499a-a63c-483caca5bed3", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45842025-01-11T05:34:40.896ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45852025-01-11T05:34:40.897ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
45862025-01-11T05:34:40.897ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45872025-01-11T05:34:40.897ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
45882025-01-11T05:34:40.897ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 295.250413ms iteration = 12 status = {"generation":2}
45892025-01-11T05:34:40.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "32f31398-2101-4edf-a80b-b52221d3e7dd", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45902025-01-11T05:34:40.898ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45912025-01-11T05:34:40.900ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45922025-01-11T05:34:40.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 298.216868ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45932025-01-11T05:34:40.902ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 300.383105ms iteration = 23 status = {}
45942025-01-11T05:34:40.904ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45952025-01-11T05:34:40.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 302.732257ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45962025-01-11T05:34:40.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
45972025-01-11T05:34:40.931ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45982025-01-11T05:34:40.931ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d812f079-28ab-47cf-bd5d-e9fa84009bc6", "content-length": "26", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
45992025-01-11T05:34:40.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46002025-01-11T05:34:40.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46012025-01-11T05:34:40.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46022025-01-11T05:34:40.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
46032025-01-11T05:34:40.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042025-01-11T05:34:40.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46052025-01-11T05:34:40.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46062025-01-11T05:34:40.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46072025-01-11T05:34:40.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082025-01-11T05:34:40.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46092025-01-11T05:34:40.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46102025-01-11T05:34:40.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46112025-01-11T05:34:40.996ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46122025-01-11T05:34:40.996ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "73f24d40-8ccc-408d-b039-5ff730679b39", "content-length": "1", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
46132025-01-11T05:34:40.998ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46142025-01-11T05:34:40.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46152025-01-11T05:34:40.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46162025-01-11T05:34:40.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 77e4903c-a6f8-4686-9b3d-c71ff65e0803 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46172025-01-11T05:34:40.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 77e4903c-a6f8-4686-9b3d-c71ff65e0803 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46182025-01-11T05:34:41.000ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 398.217767ms iteration = 23 status = null
46192025-01-11T05:34:41.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 77e4903c-a6f8-4686-9b3d-c71ff65e0803 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46202025-01-11T05:34:41.054ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46212025-01-11T05:34:41.054ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2689ad69-7884-46c0-aeaa-bd78cfc3e314", "content-length": "691", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
46222025-01-11T05:34:41.054ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46232025-01-11T05:34:41.054ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46242025-01-11T05:34:41.054ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46252025-01-11T05:34:41.055ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 453.180861ms iteration = 23 status = {}
46262025-01-11T05:34:41.151ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46272025-01-11T05:34:41.151ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "31f9ea1e-a644-4358-a741-b9363a61c88c", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46282025-01-11T05:34:41.151ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46292025-01-11T05:34:41.153ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f1b482b9-75fd-4258-aabd-6af7c4380ef3", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46302025-01-11T05:34:41.153ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46312025-01-11T05:34:41.155ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c3f7f7de-86e8-4c69-955f-0ba0209f0c30", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46322025-01-11T05:34:41.155ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46332025-01-11T05:34:41.156ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
46342025-01-11T05:34:41.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.895507ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46352025-01-11T05:34:41.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46362025-01-11T05:34:41.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46372025-01-11T05:34:41.203ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
46382025-01-11T05:34:41.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46392025-01-11T05:34:41.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46402025-01-11T05:34:41.212ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46412025-01-11T05:34:41.212ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "695b419e-5bf1-4cbe-b1ef-701aff19f5ee", "content-length": "134", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} })
46422025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46432025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
46442025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46452025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46462025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46472025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46482025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46492025-01-11T05:34:41.212ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46502025-01-11T05:34:41.213ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46512025-01-11T05:34:41.213ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46522025-01-11T05:34:41.213ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
46532025-01-11T05:34:41.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46542025-01-11T05:34:41.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46552025-01-11T05:34:41.215ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46562025-01-11T05:34:41.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ba67499-082b-44b9-b8f5-e16cd67730cd", "content-length": "2", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} })
46572025-01-11T05:34:41.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46582025-01-11T05:34:41.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f767f173-a8b2-4a09-bec1-f49fee32aded", "content-length": "52", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} })
46592025-01-11T05:34:41.216ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
46602025-01-11T05:34:41.216ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46612025-01-11T05:34:41.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f5e5e04-a5c4-4692-bf6a-eb30d19a2ea3", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
46622025-01-11T05:34:41.316ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
46632025-01-11T05:34:41.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46642025-01-11T05:34:41.318ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3e47b4f-c7fc-43cb-b82d-f75451c796f6", "content-length": "682", "date": "Sat, 11 Jan 2025 05:34:40 GMT"} })
46652025-01-11T05:34:41.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46662025-01-11T05:34:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46672025-01-11T05:34:41.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46682025-01-11T05:34:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46692025-01-11T05:34:41.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46702025-01-11T05:34:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46712025-01-11T05:34:41.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46722025-01-11T05:34:41.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46732025-01-11T05:34:41.336ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 734.221772ms iteration = 23 status = {}
46742025-01-11T05:34:41.563ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
46752025-01-11T05:34:41.563ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
46762025-01-11T05:34:41.594ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
46772025-01-11T05:34:41.594ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:61106
46782025-01-11T05:34:41.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61106 req_id = 76baa6ce-6e55-47a8-bf8c-7aaef4f02bdb roles = RoleSet { roles: {} } uri = /metrics/producers
46792025-01-11T05:34:41.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61106 req_id = 76baa6ce-6e55-47a8-bf8c-7aaef4f02bdb resource = Database result = Ok(()) uri = /metrics/producers
46802025-01-11T05:34:41.651ZINFOnexus: assigned collector to new producer collector_id = 68ba0762-4eeb-4568-8923-69d504e34a00 file = nexus/src/app/oximeter.rs:76 producer_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
46812025-01-11T05:34:41.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57583 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61106 req_id = 76baa6ce-6e55-47a8-bf8c-7aaef4f02bdb response_code = 201 uri = /metrics/producers
46822025-01-11T05:34:41.652ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "76baa6ce-6e55-47a8-bf8c-7aaef4f02bdb", "content-length": "41", "date": "Sat, 11 Jan 2025 05:34:41 GMT"} })
46832025-01-11T05:34:41.654ZDEBGnexus (producer-registration-task): registered with nexus successfully
46842025-01-11T05:34:41.654ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
46852025-01-11T05:34:42.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b6374227-a928-4d08-8b77-d9b3c97ffea1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46862025-01-11T05:34:42.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b6374227-a928-4d08-8b77-d9b3c97ffea1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46872025-01-11T05:34:42.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b6374227-a928-4d08-8b77-d9b3c97ffea1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46882025-01-11T05:34:42.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = a347417c-2f96-46a9-a753-1ef8ff1d614c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46892025-01-11T05:34:42.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = a347417c-2f96-46a9-a753-1ef8ff1d614c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46902025-01-11T05:34:42.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = a347417c-2f96-46a9-a753-1ef8ff1d614c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46912025-01-11T05:34:43.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 75aa8987-eb7a-4147-a91c-3147ee3dc798 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46922025-01-11T05:34:43.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 75aa8987-eb7a-4147-a91c-3147ee3dc798 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46932025-01-11T05:34:43.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 75aa8987-eb7a-4147-a91c-3147ee3dc798 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46942025-01-11T05:34:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 841 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 24bef503-7b11-49b2-b451-414cc0e4caca response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
46952025-01-11T05:34:44.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9546cfa3-4c69-4af9-90a4-3e38e2d48ded roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46962025-01-11T05:34:44.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9546cfa3-4c69-4af9-90a4-3e38e2d48ded resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46972025-01-11T05:34:44.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9546cfa3-4c69-4af9-90a4-3e38e2d48ded response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46982025-01-11T05:34:45.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e307763f-0666-4ac5-88bd-3684320dbb53 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
46992025-01-11T05:34:45.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e307763f-0666-4ac5-88bd-3684320dbb53 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47002025-01-11T05:34:45.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e307763f-0666-4ac5-88bd-3684320dbb53 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47012025-01-11T05:34:46.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = deae33d3-5c2e-48fd-9dc3-92188d0c5953 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47022025-01-11T05:34:46.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = deae33d3-5c2e-48fd-9dc3-92188d0c5953 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47032025-01-11T05:34:46.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = deae33d3-5c2e-48fd-9dc3-92188d0c5953 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47042025-01-11T05:34:47.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = db1172ce-e7d1-4620-8edd-ec389840396a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47052025-01-11T05:34:47.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = db1172ce-e7d1-4620-8edd-ec389840396a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47062025-01-11T05:34:47.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = db1172ce-e7d1-4620-8edd-ec389840396a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47072025-01-11T05:34:48.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6d676efe-e394-4a2f-8830-3400853f97e0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47082025-01-11T05:34:48.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6d676efe-e394-4a2f-8830-3400853f97e0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47092025-01-11T05:34:48.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6d676efe-e394-4a2f-8830-3400853f97e0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47102025-01-11T05:34:49.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aa0bbc47-90e6-490c-ba1b-fa195ea5e028 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47112025-01-11T05:34:49.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aa0bbc47-90e6-490c-ba1b-fa195ea5e028 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47122025-01-11T05:34:49.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aa0bbc47-90e6-490c-ba1b-fa195ea5e028 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47132025-01-11T05:34:50.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19223455-613f-4a1a-9636-6d4739d5ac0e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47142025-01-11T05:34:50.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19223455-613f-4a1a-9636-6d4739d5ac0e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47152025-01-11T05:34:50.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19223455-613f-4a1a-9636-6d4739d5ac0e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47162025-01-11T05:34:50.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
47172025-01-11T05:34:50.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
47182025-01-11T05:34:50.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47192025-01-11T05:34:50.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47202025-01-11T05:34:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47212025-01-11T05:34:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47222025-01-11T05:34:50.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47232025-01-11T05:34:50.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47242025-01-11T05:34:50.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47252025-01-11T05:34:50.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47262025-01-11T05:34:50.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47272025-01-11T05:34:50.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47282025-01-11T05:34:50.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47292025-01-11T05:34:50.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47302025-01-11T05:34:50.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47312025-01-11T05:34:50.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
47322025-01-11T05:34:50.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47332025-01-11T05:34:50.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47342025-01-11T05:34:50.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
47352025-01-11T05:34:50.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.322571ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
47362025-01-11T05:34:50.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.713046ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47372025-01-11T05:34:51.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9477b813-d654-4709-9ae5-54f68762e3ec roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47382025-01-11T05:34:51.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9477b813-d654-4709-9ae5-54f68762e3ec resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47392025-01-11T05:34:51.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9477b813-d654-4709-9ae5-54f68762e3ec response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47402025-01-11T05:34:52.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2049438c-8ec7-45c2-8649-1dc8d3f1ad27 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47412025-01-11T05:34:52.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2049438c-8ec7-45c2-8649-1dc8d3f1ad27 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47422025-01-11T05:34:52.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2049438c-8ec7-45c2-8649-1dc8d3f1ad27 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47432025-01-11T05:34:53.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4c8cc233-923e-4d31-ad22-f836fa5815b1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47442025-01-11T05:34:53.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4c8cc233-923e-4d31-ad22-f836fa5815b1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47452025-01-11T05:34:53.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4c8cc233-923e-4d31-ad22-f836fa5815b1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47462025-01-11T05:34:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 600 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = eabd491e-24d4-4e50-b298-fc13cc65e509 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
47472025-01-11T05:34:54.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d09ad62b-f8ba-4602-b0b8-2d968c29d36b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47482025-01-11T05:34:54.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d09ad62b-f8ba-4602-b0b8-2d968c29d36b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47492025-01-11T05:34:54.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d09ad62b-f8ba-4602-b0b8-2d968c29d36b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47502025-01-11T05:34:55.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0960dfc3-21fb-47f7-b2a4-70b4df723467 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47512025-01-11T05:34:55.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0960dfc3-21fb-47f7-b2a4-70b4df723467 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47522025-01-11T05:34:55.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0960dfc3-21fb-47f7-b2a4-70b4df723467 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47532025-01-11T05:34:56.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4628b750-b650-474e-86cd-1ff8314ebda2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47542025-01-11T05:34:56.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4628b750-b650-474e-86cd-1ff8314ebda2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47552025-01-11T05:34:56.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4628b750-b650-474e-86cd-1ff8314ebda2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47562025-01-11T05:34:57.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a3bfeda-79d5-4806-92b0-b2dc86848406 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47572025-01-11T05:34:57.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a3bfeda-79d5-4806-92b0-b2dc86848406 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47582025-01-11T05:34:57.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a3bfeda-79d5-4806-92b0-b2dc86848406 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47592025-01-11T05:34:58.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cd129538-8538-43d1-a142-f928fcf43e79 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47602025-01-11T05:34:58.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cd129538-8538-43d1-a142-f928fcf43e79 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47612025-01-11T05:34:58.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cd129538-8538-43d1-a142-f928fcf43e79 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47622025-01-11T05:34:59.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 931ed971-fea7-473c-8589-92154419a322 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47632025-01-11T05:34:59.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 931ed971-fea7-473c-8589-92154419a322 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47642025-01-11T05:34:59.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 931ed971-fea7-473c-8589-92154419a322 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47652025-01-11T05:35:00.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cc1acd45-ff5a-4355-9665-eb8cde3fb490 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47662025-01-11T05:35:00.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cc1acd45-ff5a-4355-9665-eb8cde3fb490 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47672025-01-11T05:35:00.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cc1acd45-ff5a-4355-9665-eb8cde3fb490 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47682025-01-11T05:35:00.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
47692025-01-11T05:35:00.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
47702025-01-11T05:35:00.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47712025-01-11T05:35:00.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47722025-01-11T05:35:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47732025-01-11T05:35:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47742025-01-11T05:35:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47752025-01-11T05:35:00.605ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47762025-01-11T05:35:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47772025-01-11T05:35:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47782025-01-11T05:35:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47792025-01-11T05:35:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47802025-01-11T05:35:00.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47812025-01-11T05:35:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47822025-01-11T05:35:00.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832025-01-11T05:35:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
47842025-01-11T05:35:00.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47852025-01-11T05:35:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47862025-01-11T05:35:00.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
47872025-01-11T05:35:00.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.986435ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
47882025-01-11T05:35:00.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.664047ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47892025-01-11T05:35:01.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a624b89f-f8bc-4afe-a85a-fcc091e168b7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47902025-01-11T05:35:01.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a624b89f-f8bc-4afe-a85a-fcc091e168b7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47912025-01-11T05:35:01.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a624b89f-f8bc-4afe-a85a-fcc091e168b7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47922025-01-11T05:35:02.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6f6f13c6-d622-41a5-a317-a4968e2d762e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47932025-01-11T05:35:02.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6f6f13c6-d622-41a5-a317-a4968e2d762e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47942025-01-11T05:35:02.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6f6f13c6-d622-41a5-a317-a4968e2d762e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47952025-01-11T05:35:03.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e53a2f3d-7766-4dc1-8ba6-f08e6dcfcc34 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47962025-01-11T05:35:03.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e53a2f3d-7766-4dc1-8ba6-f08e6dcfcc34 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47972025-01-11T05:35:03.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e53a2f3d-7766-4dc1-8ba6-f08e6dcfcc34 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
47982025-01-11T05:35:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = a0f4ad17-e802-458c-86e1-f7c0de30f9a7 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
47992025-01-11T05:35:04.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b0a111a5-4fc8-42ab-bf14-27be15bfa48a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48002025-01-11T05:35:04.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b0a111a5-4fc8-42ab-bf14-27be15bfa48a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48012025-01-11T05:35:04.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b0a111a5-4fc8-42ab-bf14-27be15bfa48a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48022025-01-11T05:35:05.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08f75769-e5f7-4021-a814-c4165b0542c2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48032025-01-11T05:35:05.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08f75769-e5f7-4021-a814-c4165b0542c2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48042025-01-11T05:35:05.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 08f75769-e5f7-4021-a814-c4165b0542c2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48052025-01-11T05:35:06.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7cd35107-de20-4805-8f89-200148838440 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48062025-01-11T05:35:06.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7cd35107-de20-4805-8f89-200148838440 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48072025-01-11T05:35:06.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7cd35107-de20-4805-8f89-200148838440 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48082025-01-11T05:35:07.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 59b98db3-2587-4865-b00f-0d43af4161ad roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48092025-01-11T05:35:07.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 59b98db3-2587-4865-b00f-0d43af4161ad resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48102025-01-11T05:35:07.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 59b98db3-2587-4865-b00f-0d43af4161ad response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48112025-01-11T05:35:08.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9a309508-e8c7-4ba0-a8e0-a7e3cfe299e6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48122025-01-11T05:35:08.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9a309508-e8c7-4ba0-a8e0-a7e3cfe299e6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48132025-01-11T05:35:08.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9a309508-e8c7-4ba0-a8e0-a7e3cfe299e6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48142025-01-11T05:35:09.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 863f228e-3f7e-4810-be50-8925cf173b7a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48152025-01-11T05:35:09.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 863f228e-3f7e-4810-be50-8925cf173b7a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48162025-01-11T05:35:09.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 863f228e-3f7e-4810-be50-8925cf173b7a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48172025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
48182025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48192025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
48202025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
48212025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48222025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48232025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
48242025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
48252025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48262025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
48272025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48282025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
48292025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
48302025-01-11T05:35:10.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48312025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48322025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48332025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
48342025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
48352025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48362025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48372025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48382025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
48392025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48402025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
48412025-01-11T05:35:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48422025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
48432025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48442025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
48452025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48462025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
48472025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
48482025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48492025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48502025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48512025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48522025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48532025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48542025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48552025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48562025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48572025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48582025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48592025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48602025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48612025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48622025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48632025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48642025-01-11T05:35:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48652025-01-11T05:35:10.603ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
48662025-01-11T05:35:10.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48672025-01-11T05:35:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48682025-01-11T05:35:10.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692025-01-11T05:35:10.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48702025-01-11T05:35:10.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712025-01-11T05:35:10.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.827084ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48722025-01-11T05:35:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48732025-01-11T05:35:10.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48742025-01-11T05:35:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48752025-01-11T05:35:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48762025-01-11T05:35:10.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48772025-01-11T05:35:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48782025-01-11T05:35:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48792025-01-11T05:35:10.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48802025-01-11T05:35:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48812025-01-11T05:35:10.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1650, tv_nsec: 167209350 } })
48822025-01-11T05:35:10.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
48832025-01-11T05:35:10.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48842025-01-11T05:35:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48852025-01-11T05:35:10.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48862025-01-11T05:35:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48872025-01-11T05:35:10.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48882025-01-11T05:35:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48892025-01-11T05:35:10.615ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1650, tv_nsec: 171671877 } })
48902025-01-11T05:35:10.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
48912025-01-11T05:35:10.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48922025-01-11T05:35:10.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1650, tv_nsec: 179960999 } })
48932025-01-11T05:35:10.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48942025-01-11T05:35:10.624ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
48952025-01-11T05:35:10.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48962025-01-11T05:35:10.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48972025-01-11T05:35:10.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a5f0cec8-62b6-434e-bae1-628fe504d8c8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48982025-01-11T05:35:10.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a5f0cec8-62b6-434e-bae1-628fe504d8c8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
48992025-01-11T05:35:10.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49002025-01-11T05:35:10.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49012025-01-11T05:35:10.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a5f0cec8-62b6-434e-bae1-628fe504d8c8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
49022025-01-11T05:35:10.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.567689ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
49032025-01-11T05:35:10.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49042025-01-11T05:35:10.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.301611ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
49052025-01-11T05:35:10.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49062025-01-11T05:35:10.649ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49072025-01-11T05:35:10.649ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49082025-01-11T05:35:10.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49092025-01-11T05:35:10.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49102025-01-11T05:35:10.650ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49112025-01-11T05:35:10.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122025-01-11T05:35:10.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49132025-01-11T05:35:10.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49142025-01-11T05:35:10.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49152025-01-11T05:35:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49162025-01-11T05:35:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49172025-01-11T05:35:10.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49182025-01-11T05:35:10.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49192025-01-11T05:35:10.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49202025-01-11T05:35:10.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49212025-01-11T05:35:10.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49222025-01-11T05:35:10.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49232025-01-11T05:35:10.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49242025-01-11T05:35:10.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49252025-01-11T05:35:10.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49262025-01-11T05:35:10.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49272025-01-11T05:35:10.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49282025-01-11T05:35:10.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49292025-01-11T05:35:10.659ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49302025-01-11T05:35:10.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.276306ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49312025-01-11T05:35:10.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49322025-01-11T05:35:10.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49332025-01-11T05:35:10.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
49342025-01-11T05:35:10.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49352025-01-11T05:35:10.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49362025-01-11T05:35:10.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.069834ms iteration = 24 status = 0
49372025-01-11T05:35:10.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.422747ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49382025-01-11T05:35:10.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.662264ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49392025-01-11T05:35:10.687ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49402025-01-11T05:35:10.687ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49412025-01-11T05:35:10.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49422025-01-11T05:35:10.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49432025-01-11T05:35:10.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.27196ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49442025-01-11T05:35:10.689ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49452025-01-11T05:35:10.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49462025-01-11T05:35:10.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
49472025-01-11T05:35:10.689ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49482025-01-11T05:35:10.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49492025-01-11T05:35:10.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49502025-01-11T05:35:10.690ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48a1ac55-ca0b-4374-8086-6a2b47948c1c", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
49512025-01-11T05:35:10.690ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49522025-01-11T05:35:10.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
49532025-01-11T05:35:10.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
49542025-01-11T05:35:10.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49552025-01-11T05:35:10.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49562025-01-11T05:35:10.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49572025-01-11T05:35:10.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582025-01-11T05:35:10.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49592025-01-11T05:35:10.694ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49602025-01-11T05:35:10.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49612025-01-11T05:35:10.694ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05286e19-bc74-402d-8cb4-9483eb3f1ad3", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
49622025-01-11T05:35:10.694ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49632025-01-11T05:35:10.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49642025-01-11T05:35:10.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49652025-01-11T05:35:10.705ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49662025-01-11T05:35:10.706ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "044c8869-8067-4166-81e0-85f0212c7705", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
49672025-01-11T05:35:10.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49682025-01-11T05:35:10.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49692025-01-11T05:35:10.713ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
49702025-01-11T05:35:10.713ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.530571ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
49712025-01-11T05:35:10.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.656948ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
49722025-01-11T05:35:10.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49732025-01-11T05:35:10.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49742025-01-11T05:35:10.725ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49752025-01-11T05:35:10.725ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49762025-01-11T05:35:10.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.392021ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49772025-01-11T05:35:10.754ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.061601ms iteration = 27 status = {"physical_disks_added":0}
49782025-01-11T05:35:10.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49792025-01-11T05:35:10.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49802025-01-11T05:35:10.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49812025-01-11T05:35:10.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49822025-01-11T05:35:10.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49832025-01-11T05:35:10.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49842025-01-11T05:35:10.798ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49852025-01-11T05:35:10.799ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c449b30f-bddc-4df1-b9bf-6286b252f724", "content-length": "1", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
49862025-01-11T05:35:10.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49872025-01-11T05:35:10.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49882025-01-11T05:35:10.810ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 208.851482ms iteration = 24 status = {}
49892025-01-11T05:35:10.855ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49902025-01-11T05:35:10.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49912025-01-11T05:35:10.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e02a8802-2a3e-40e0-bff0-6a2e0e2e6b50", "content-length": "372", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
49922025-01-11T05:35:10.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49932025-01-11T05:35:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49942025-01-11T05:35:10.858ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 256.519176ms iteration = 24 status = null
49952025-01-11T05:35:10.871ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49962025-01-11T05:35:10.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49972025-01-11T05:35:10.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6b9eddc2-34aa-4429-b179-93103f6d5945", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
49982025-01-11T05:35:10.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49992025-01-11T05:35:10.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50002025-01-11T05:35:10.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50012025-01-11T05:35:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50022025-01-11T05:35:10.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50032025-01-11T05:35:10.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50042025-01-11T05:35:10.879ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50052025-01-11T05:35:10.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50062025-01-11T05:35:10.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "db1f2a2b-e127-4a14-8b0a-072fa3c1f94c", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
50072025-01-11T05:35:10.881ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.304325ms iteration = 24 status = {}
50082025-01-11T05:35:10.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50092025-01-11T05:35:10.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50102025-01-11T05:35:10.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112025-01-11T05:35:10.885ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
50122025-01-11T05:35:10.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50132025-01-11T05:35:10.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50142025-01-11T05:35:10.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50152025-01-11T05:35:10.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50162025-01-11T05:35:10.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50172025-01-11T05:35:10.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50182025-01-11T05:35:10.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f459751-016f-4c50-9496-3888b03192e8", "content-length": "134", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
50192025-01-11T05:35:10.895ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50202025-01-11T05:35:10.895ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
50212025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50222025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50232025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50242025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50252025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50262025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50272025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50282025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50292025-01-11T05:35:10.896ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
50302025-01-11T05:35:10.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50312025-01-11T05:35:10.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50322025-01-11T05:35:10.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50332025-01-11T05:35:10.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "951b03b2-5525-4cbd-9ec3-7b84b818a298", "content-length": "2", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
50342025-01-11T05:35:10.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50352025-01-11T05:35:10.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "35b0fb26-be2b-46e9-a3be-67af3ca9695a", "content-length": "52", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
50362025-01-11T05:35:10.899ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
50372025-01-11T05:35:10.899ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50382025-01-11T05:35:10.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50392025-01-11T05:35:11.000ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7c05197-fb51-42c5-a6b8-d5aba2f3c752", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
50402025-01-11T05:35:11.000ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
50412025-01-11T05:35:11.000ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50422025-01-11T05:35:11.000ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1ff2559-4860-4724-ba7b-1bdfe4a761c0", "content-length": "682", "date": "Sat, 11 Jan 2025 05:35:10 GMT"} })
50432025-01-11T05:35:11.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50442025-01-11T05:35:11.000ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0ddc739-f2b8-44d4-a9e4-42787578cd65", "content-length": "691", "date": "Sat, 11 Jan 2025 05:35:11 GMT"} })
50452025-01-11T05:35:11.000ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50462025-01-11T05:35:11.000ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50472025-01-11T05:35:11.000ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50482025-01-11T05:35:11.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50492025-01-11T05:35:11.002ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 400.426756ms iteration = 24 status = {}
50502025-01-11T05:35:11.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50512025-01-11T05:35:11.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50522025-01-11T05:35:11.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50532025-01-11T05:35:11.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50542025-01-11T05:35:11.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50552025-01-11T05:35:11.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50562025-01-11T05:35:11.017ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 415.798722ms iteration = 24 status = {}
50572025-01-11T05:35:11.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bef4a036-cbba-452e-84b3-d4dd433f54b1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50582025-01-11T05:35:11.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bef4a036-cbba-452e-84b3-d4dd433f54b1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50592025-01-11T05:35:11.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bef4a036-cbba-452e-84b3-d4dd433f54b1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50602025-01-11T05:35:12.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 215fc3f4-4a4f-4590-88ce-8c9e5072f7c6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
50612025-01-11T05:35:12.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 215fc3f4-4a4f-4590-88ce-8c9e5072f7c6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
50622025-01-11T05:35:12.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 215fc3f4-4a4f-4590-88ce-8c9e5072f7c6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
50632025-01-11T05:35:12.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19fb4a9f-cda1-471d-b700-2c300b8cc609 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50642025-01-11T05:35:12.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19fb4a9f-cda1-471d-b700-2c300b8cc609 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50652025-01-11T05:35:12.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19fb4a9f-cda1-471d-b700-2c300b8cc609 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50662025-01-11T05:35:13.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 48bd95a1-37f9-443a-8da1-e45885c99ea5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50672025-01-11T05:35:13.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 48bd95a1-37f9-443a-8da1-e45885c99ea5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50682025-01-11T05:35:13.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 48bd95a1-37f9-443a-8da1-e45885c99ea5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50692025-01-11T05:35:13.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = f2f56cf6-cbf0-4b18-855b-cb35d23b3122 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
50702025-01-11T05:35:14.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 44c0471b-7609-47d8-8f9e-d3e655d1fd6e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50712025-01-11T05:35:14.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 44c0471b-7609-47d8-8f9e-d3e655d1fd6e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50722025-01-11T05:35:14.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 44c0471b-7609-47d8-8f9e-d3e655d1fd6e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50732025-01-11T05:35:15.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05aa1273-a17b-4bba-b25f-fac661f2b18b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50742025-01-11T05:35:15.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05aa1273-a17b-4bba-b25f-fac661f2b18b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50752025-01-11T05:35:15.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05aa1273-a17b-4bba-b25f-fac661f2b18b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50762025-01-11T05:35:16.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6bf8bbbd-4d14-4fd7-b9db-e859f0300636 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50772025-01-11T05:35:16.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6bf8bbbd-4d14-4fd7-b9db-e859f0300636 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50782025-01-11T05:35:16.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6bf8bbbd-4d14-4fd7-b9db-e859f0300636 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50792025-01-11T05:35:17.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a91315f1-0599-4162-9546-7f7eb805c9fd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50802025-01-11T05:35:17.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a91315f1-0599-4162-9546-7f7eb805c9fd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50812025-01-11T05:35:17.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a91315f1-0599-4162-9546-7f7eb805c9fd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50822025-01-11T05:35:18.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4cd8c359-919f-48ac-afa7-67820091dceb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50832025-01-11T05:35:18.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4cd8c359-919f-48ac-afa7-67820091dceb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50842025-01-11T05:35:18.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4cd8c359-919f-48ac-afa7-67820091dceb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50852025-01-11T05:35:19.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5bcf920c-6aab-4e88-a2a7-ef8c8afd6343 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50862025-01-11T05:35:19.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5bcf920c-6aab-4e88-a2a7-ef8c8afd6343 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50872025-01-11T05:35:19.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5bcf920c-6aab-4e88-a2a7-ef8c8afd6343 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
50882025-01-11T05:35:20.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
50892025-01-11T05:35:20.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
50902025-01-11T05:35:20.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50912025-01-11T05:35:20.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50922025-01-11T05:35:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50932025-01-11T05:35:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50942025-01-11T05:35:20.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50952025-01-11T05:35:20.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50962025-01-11T05:35:20.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50972025-01-11T05:35:20.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50982025-01-11T05:35:20.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50992025-01-11T05:35:20.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51002025-01-11T05:35:20.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51012025-01-11T05:35:20.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51022025-01-11T05:35:20.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.735611ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51032025-01-11T05:35:20.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042025-01-11T05:35:20.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
51052025-01-11T05:35:20.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51062025-01-11T05:35:20.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51072025-01-11T05:35:20.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
51082025-01-11T05:35:20.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.36542ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
51092025-01-11T05:35:20.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ffdf868e-76ac-457c-8ebc-099176e0ff39 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51102025-01-11T05:35:20.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ffdf868e-76ac-457c-8ebc-099176e0ff39 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51112025-01-11T05:35:20.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ffdf868e-76ac-457c-8ebc-099176e0ff39 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51122025-01-11T05:35:21.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aec324bb-1e8a-4820-88cd-2079e1449e62 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51132025-01-11T05:35:21.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aec324bb-1e8a-4820-88cd-2079e1449e62 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51142025-01-11T05:35:21.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aec324bb-1e8a-4820-88cd-2079e1449e62 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51152025-01-11T05:35:22.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 381edf0b-7f32-4cb6-9093-c0613f9285de roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51162025-01-11T05:35:22.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 381edf0b-7f32-4cb6-9093-c0613f9285de resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51172025-01-11T05:35:22.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 381edf0b-7f32-4cb6-9093-c0613f9285de response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51182025-01-11T05:35:23.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 12be0ecc-8925-42b1-a2fa-13d260a5ab73 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51192025-01-11T05:35:23.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 12be0ecc-8925-42b1-a2fa-13d260a5ab73 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51202025-01-11T05:35:23.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 12be0ecc-8925-42b1-a2fa-13d260a5ab73 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51212025-01-11T05:35:23.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 963e2206-4dcb-4353-8f97-2c00fda1f90b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
51222025-01-11T05:35:23.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 963e2206-4dcb-4353-8f97-2c00fda1f90b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
51232025-01-11T05:35:23.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 963e2206-4dcb-4353-8f97-2c00fda1f90b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
51242025-01-11T05:35:23.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = aeedde34-98eb-471b-9069-e097aa807a03 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
51252025-01-11T05:35:23.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = aeedde34-98eb-471b-9069-e097aa807a03 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
51262025-01-11T05:35:23.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = aeedde34-98eb-471b-9069-e097aa807a03 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
51272025-01-11T05:35:23.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8ba06103-805b-4ff8-9675-75c0ec651d23 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
51282025-01-11T05:35:23.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8ba06103-805b-4ff8-9675-75c0ec651d23 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
51292025-01-11T05:35:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 887 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 1d4e7fde-8699-4615-8fdc-42376971744f response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
51302025-01-11T05:35:23.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8ba06103-805b-4ff8-9675-75c0ec651d23 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
51312025-01-11T05:35:23.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c485daa7-001f-4589-980c-cb190571c0dd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51322025-01-11T05:35:23.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c485daa7-001f-4589-980c-cb190571c0dd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51332025-01-11T05:35:23.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c485daa7-001f-4589-980c-cb190571c0dd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51342025-01-11T05:35:24.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b18a25f3-475f-43fd-8c95-e4488eb93faa roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51352025-01-11T05:35:24.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b18a25f3-475f-43fd-8c95-e4488eb93faa resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51362025-01-11T05:35:24.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b18a25f3-475f-43fd-8c95-e4488eb93faa response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51372025-01-11T05:35:26.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fa8e050f-2796-4cd6-b153-31bd6fcc537a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51382025-01-11T05:35:26.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fa8e050f-2796-4cd6-b153-31bd6fcc537a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51392025-01-11T05:35:26.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fa8e050f-2796-4cd6-b153-31bd6fcc537a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51402025-01-11T05:35:27.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2ab12210-d780-4105-8aaa-4248d89fedf3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51412025-01-11T05:35:27.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2ab12210-d780-4105-8aaa-4248d89fedf3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51422025-01-11T05:35:27.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2ab12210-d780-4105-8aaa-4248d89fedf3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51432025-01-11T05:35:28.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e58ca33c-4195-4930-b0fa-2afa0c588dfe roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51442025-01-11T05:35:28.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e58ca33c-4195-4930-b0fa-2afa0c588dfe resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51452025-01-11T05:35:28.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e58ca33c-4195-4930-b0fa-2afa0c588dfe response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51462025-01-11T05:35:29.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ac420535-35ca-47e3-a7e1-724e0f8c5303 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51472025-01-11T05:35:29.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ac420535-35ca-47e3-a7e1-724e0f8c5303 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51482025-01-11T05:35:29.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ac420535-35ca-47e3-a7e1-724e0f8c5303 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51492025-01-11T05:35:30.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58b7dd74-49e7-4dfd-9552-1132306193ea roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51502025-01-11T05:35:30.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58b7dd74-49e7-4dfd-9552-1132306193ea resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51512025-01-11T05:35:30.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 58b7dd74-49e7-4dfd-9552-1132306193ea response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51522025-01-11T05:35:30.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
51532025-01-11T05:35:30.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
51542025-01-11T05:35:30.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51552025-01-11T05:35:30.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51562025-01-11T05:35:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51572025-01-11T05:35:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51582025-01-11T05:35:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51592025-01-11T05:35:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51602025-01-11T05:35:30.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51612025-01-11T05:35:30.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.888075ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51622025-01-11T05:35:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51632025-01-11T05:35:30.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51642025-01-11T05:35:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51652025-01-11T05:35:30.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51662025-01-11T05:35:30.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51672025-01-11T05:35:30.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51682025-01-11T05:35:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
51692025-01-11T05:35:30.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51702025-01-11T05:35:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51712025-01-11T05:35:30.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
51722025-01-11T05:35:30.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.09615ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
51732025-01-11T05:35:30.772ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 10cd5963-6855-416c-ae15-11469f8ad756 uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-11T05:35:30.743576499Z }
51742025-01-11T05:35:30.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 10cd5963-6855-416c-ae15-11469f8ad756 roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
51752025-01-11T05:35:30.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 10cd5963-6855-416c-ae15-11469f8ad756 resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
51762025-01-11T05:35:30.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51677 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 10cd5963-6855-416c-ae15-11469f8ad756 response_code = 204 uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
51772025-01-11T05:35:30.796ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cdbadf12-0784-4f05-b7c9-dd794e166e6f uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-11T05:35:30.796337274Z }
51782025-01-11T05:35:30.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cdbadf12-0784-4f05-b7c9-dd794e166e6f roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
51792025-01-11T05:35:30.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cdbadf12-0784-4f05-b7c9-dd794e166e6f resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
51802025-01-11T05:35:30.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10937 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cdbadf12-0784-4f05-b7c9-dd794e166e6f response_code = 204 uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
51812025-01-11T05:35:31.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ed142680-7324-4280-869a-40aa0a562f9b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51822025-01-11T05:35:31.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ed142680-7324-4280-869a-40aa0a562f9b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51832025-01-11T05:35:31.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ed142680-7324-4280-869a-40aa0a562f9b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51842025-01-11T05:35:32.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3f9a2210-bd6c-41cc-b56d-451001e6c9e3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51852025-01-11T05:35:32.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3f9a2210-bd6c-41cc-b56d-451001e6c9e3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51862025-01-11T05:35:32.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3f9a2210-bd6c-41cc-b56d-451001e6c9e3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51872025-01-11T05:35:33.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64ef2e70-3c6f-4b4f-92fb-ccab75643c54 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51882025-01-11T05:35:33.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64ef2e70-3c6f-4b4f-92fb-ccab75643c54 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51892025-01-11T05:35:33.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 64ef2e70-3c6f-4b4f-92fb-ccab75643c54 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51902025-01-11T05:35:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 669 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 326a5556-6ff2-4662-a33b-9fa7ff509271 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
51912025-01-11T05:35:34.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a5a835a8-35ac-4608-968a-d8234c7b2a11 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51922025-01-11T05:35:34.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a5a835a8-35ac-4608-968a-d8234c7b2a11 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51932025-01-11T05:35:34.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a5a835a8-35ac-4608-968a-d8234c7b2a11 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51942025-01-11T05:35:35.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc2bb4f8-3d0c-44f9-a91b-54364881c52e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51952025-01-11T05:35:35.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc2bb4f8-3d0c-44f9-a91b-54364881c52e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51962025-01-11T05:35:35.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fc2bb4f8-3d0c-44f9-a91b-54364881c52e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51972025-01-11T05:35:36.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36cabc60-0786-4662-9f87-e18ca3c88e25 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51982025-01-11T05:35:36.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36cabc60-0786-4662-9f87-e18ca3c88e25 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
51992025-01-11T05:35:36.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36cabc60-0786-4662-9f87-e18ca3c88e25 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52002025-01-11T05:35:37.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b9e66a44-e12b-4ee1-89bc-bd622da1874b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52012025-01-11T05:35:37.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b9e66a44-e12b-4ee1-89bc-bd622da1874b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52022025-01-11T05:35:37.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b9e66a44-e12b-4ee1-89bc-bd622da1874b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52032025-01-11T05:35:38.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8d6cc881-7289-40c8-b118-25e875f873d8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52042025-01-11T05:35:38.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8d6cc881-7289-40c8-b118-25e875f873d8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52052025-01-11T05:35:38.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8d6cc881-7289-40c8-b118-25e875f873d8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52062025-01-11T05:35:38.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 85ed06e4-9a61-4072-9879-855e0d3835ec roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
52072025-01-11T05:35:38.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 85ed06e4-9a61-4072-9879-855e0d3835ec resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
52082025-01-11T05:35:38.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 85ed06e4-9a61-4072-9879-855e0d3835ec response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
52092025-01-11T05:35:38.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7fed558f-2349-4d43-b6fc-76a62a55dc71 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
52102025-01-11T05:35:38.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7fed558f-2349-4d43-b6fc-76a62a55dc71 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
52112025-01-11T05:35:38.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7fed558f-2349-4d43-b6fc-76a62a55dc71 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
52122025-01-11T05:35:39.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 31dd328e-5205-40f7-9882-9f376bdde18a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52132025-01-11T05:35:39.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 31dd328e-5205-40f7-9882-9f376bdde18a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52142025-01-11T05:35:39.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 31dd328e-5205-40f7-9882-9f376bdde18a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52152025-01-11T05:35:40.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e6fd3b02-b0e4-4ebf-a29d-5486b18aa6fa roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52162025-01-11T05:35:40.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e6fd3b02-b0e4-4ebf-a29d-5486b18aa6fa resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52172025-01-11T05:35:40.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e6fd3b02-b0e4-4ebf-a29d-5486b18aa6fa response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
52182025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
52192025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
52202025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52212025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
52222025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52232025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52242025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52252025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
52262025-01-11T05:35:40.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52272025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52282025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
52292025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52302025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
52312025-01-11T05:35:40.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52322025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52332025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
52342025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52352025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
52362025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52372025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
52382025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
52392025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52402025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
52412025-01-11T05:35:40.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
52422025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.38\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
52432025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
52442025-01-11T05:35:40.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52452025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
52462025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52472025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
52482025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52492025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
52502025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52512025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
52522025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
52532025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52542025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52552025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
52562025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52572025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
52582025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
52592025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52602025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
52612025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52622025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
52632025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
52642025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
52652025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52662025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52672025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
52682025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52692025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52702025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
52712025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
52722025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
52732025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52742025-01-11T05:35:40.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:25:40.602217888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52752025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52762025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
52772025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
52782025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52792025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52802025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
52812025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52822025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52832025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52842025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52852025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52862025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52872025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52882025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52892025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52902025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52912025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52922025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52932025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52942025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52952025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52962025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52972025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52982025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52992025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53002025-01-11T05:35:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1680, tv_nsec: 158911342 } })
53012025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53022025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53032025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53042025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53052025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53062025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53072025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53082025-01-11T05:35:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1680, tv_nsec: 158984674 } })
53092025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53102025-01-11T05:35:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53112025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53122025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53132025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53142025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53152025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.213037ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53162025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53172025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53182025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
53192025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.203856ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
53202025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53212025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53222025-01-11T05:35:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53232025-01-11T05:35:40.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53242025-01-11T05:35:40.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.601649ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53252025-01-11T05:35:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.56838ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
53262025-01-11T05:35:40.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53272025-01-11T05:35:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53282025-01-11T05:35:40.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53292025-01-11T05:35:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53302025-01-11T05:35:40.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53312025-01-11T05:35:40.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53322025-01-11T05:35:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53332025-01-11T05:35:40.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53342025-01-11T05:35:40.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53352025-01-11T05:35:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53362025-01-11T05:35:40.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53372025-01-11T05:35:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53382025-01-11T05:35:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53392025-01-11T05:35:40.615ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53402025-01-11T05:35:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53412025-01-11T05:35:40.615ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1680, tv_nsec: 171712382 } })
53422025-01-11T05:35:40.615ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53432025-01-11T05:35:40.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53442025-01-11T05:35:40.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53452025-01-11T05:35:40.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1680, tv_nsec: 174387271 } })
53462025-01-11T05:35:40.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53472025-01-11T05:35:40.621ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:25:40.602217888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53482025-01-11T05:35:40.621ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.329963ms iteration = 13 status = {"expiration":"2025-01-11T05:25:40.602217888Z","pruned":[]}
53492025-01-11T05:35:40.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53502025-01-11T05:35:40.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53512025-01-11T05:35:40.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53522025-01-11T05:35:40.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53532025-01-11T05:35:40.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53542025-01-11T05:35:40.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53552025-01-11T05:35:40.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.676352ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
53562025-01-11T05:35:40.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53572025-01-11T05:35:40.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53582025-01-11T05:35:40.655ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53592025-01-11T05:35:40.655ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53602025-01-11T05:35:40.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53612025-01-11T05:35:40.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53622025-01-11T05:35:40.658ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53632025-01-11T05:35:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53642025-01-11T05:35:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53652025-01-11T05:35:40.659ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53662025-01-11T05:35:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53672025-01-11T05:35:40.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53682025-01-11T05:35:40.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53692025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53702025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712025-01-11T05:35:40.662ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53722025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53732025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53742025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53752025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53762025-01-11T05:35:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53772025-01-11T05:35:40.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53782025-01-11T05:35:40.664ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1680, tv_nsec: 220384038 } })
53792025-01-11T05:35:40.664ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
53802025-01-11T05:35:40.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53812025-01-11T05:35:40.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53822025-01-11T05:35:40.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53832025-01-11T05:35:40.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53842025-01-11T05:35:40.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.798805ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53852025-01-11T05:35:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53862025-01-11T05:35:40.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.101501ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
53872025-01-11T05:35:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53882025-01-11T05:35:40.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53892025-01-11T05:35:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53902025-01-11T05:35:40.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53912025-01-11T05:35:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53922025-01-11T05:35:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53932025-01-11T05:35:40.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942025-01-11T05:35:40.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952025-01-11T05:35:40.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.380443ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53962025-01-11T05:35:40.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972025-01-11T05:35:40.668ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53982025-01-11T05:35:40.668ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53992025-01-11T05:35:40.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54002025-01-11T05:35:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54012025-01-11T05:35:40.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54022025-01-11T05:35:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54032025-01-11T05:35:40.670ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54042025-01-11T05:35:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54052025-01-11T05:35:40.670ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54062025-01-11T05:35:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54072025-01-11T05:35:40.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54082025-01-11T05:35:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54092025-01-11T05:35:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54102025-01-11T05:35:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54112025-01-11T05:35:40.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54122025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54132025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54142025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54152025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54162025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54172025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54182025-01-11T05:35:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54192025-01-11T05:35:40.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54202025-01-11T05:35:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54212025-01-11T05:35:40.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.99211ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54222025-01-11T05:35:40.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232025-01-11T05:35:40.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54242025-01-11T05:35:40.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54252025-01-11T05:35:40.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54262025-01-11T05:35:40.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54272025-01-11T05:35:40.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54282025-01-11T05:35:40.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54292025-01-11T05:35:40.687ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54302025-01-11T05:35:40.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54312025-01-11T05:35:40.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54322025-01-11T05:35:40.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.512938ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54332025-01-11T05:35:40.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54342025-01-11T05:35:40.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352025-01-11T05:35:40.691ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 89.839017ms iteration = 6 status = {"nsuccess":5}
54362025-01-11T05:35:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54372025-01-11T05:35:40.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54382025-01-11T05:35:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54392025-01-11T05:35:40.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
54402025-01-11T05:35:40.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54412025-01-11T05:35:40.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54422025-01-11T05:35:40.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54432025-01-11T05:35:40.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54442025-01-11T05:35:40.705ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54452025-01-11T05:35:40.705ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54462025-01-11T05:35:40.705ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54472025-01-11T05:35:40.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54482025-01-11T05:35:40.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54492025-01-11T05:35:40.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54502025-01-11T05:35:40.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54512025-01-11T05:35:40.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
54522025-01-11T05:35:40.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.450048ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
54532025-01-11T05:35:40.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54542025-01-11T05:35:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54552025-01-11T05:35:40.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54562025-01-11T05:35:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54572025-01-11T05:35:40.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54582025-01-11T05:35:40.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54592025-01-11T05:35:40.719ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54602025-01-11T05:35:40.719ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54612025-01-11T05:35:40.719ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54622025-01-11T05:35:40.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54632025-01-11T05:35:40.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54642025-01-11T05:35:40.720ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54652025-01-11T05:35:40.720ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54662025-01-11T05:35:40.720ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.073855ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54672025-01-11T05:35:40.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54682025-01-11T05:35:40.724ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54692025-01-11T05:35:40.724ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54702025-01-11T05:35:40.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.125546ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54712025-01-11T05:35:40.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54722025-01-11T05:35:40.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54732025-01-11T05:35:40.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54742025-01-11T05:35:40.728ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54752025-01-11T05:35:40.728ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
54762025-01-11T05:35:40.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54772025-01-11T05:35:40.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54782025-01-11T05:35:40.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.447108ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
54792025-01-11T05:35:40.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54802025-01-11T05:35:40.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54812025-01-11T05:35:40.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822025-01-11T05:35:40.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54832025-01-11T05:35:40.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54842025-01-11T05:35:40.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54852025-01-11T05:35:40.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54862025-01-11T05:35:40.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54872025-01-11T05:35:40.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54882025-01-11T05:35:40.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54892025-01-11T05:35:40.739ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
54902025-01-11T05:35:40.739ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54912025-01-11T05:35:40.739ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
54922025-01-11T05:35:40.739ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 136.856976ms iteration = 13 status = {"generation":2}
54932025-01-11T05:35:40.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54942025-01-11T05:35:40.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54952025-01-11T05:35:40.751ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54962025-01-11T05:35:40.751ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54972025-01-11T05:35:40.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54982025-01-11T05:35:40.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54992025-01-11T05:35:40.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55002025-01-11T05:35:40.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
55012025-01-11T05:35:40.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55022025-01-11T05:35:40.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55032025-01-11T05:35:40.774ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55042025-01-11T05:35:40.774ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.340133ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55052025-01-11T05:35:40.774ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55062025-01-11T05:35:40.774ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55072025-01-11T05:35:40.774ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c7ff143-b0ac-46eb-9661-fbf6a2ce29bf", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55082025-01-11T05:35:40.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55092025-01-11T05:35:40.776ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
55102025-01-11T05:35:40.776ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 174.350797ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55112025-01-11T05:35:40.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55122025-01-11T05:35:40.792ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55132025-01-11T05:35:40.792ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55142025-01-11T05:35:40.792ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed5b4585-2243-4bda-82da-39ceeaf5ef70", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55152025-01-11T05:35:40.792ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55162025-01-11T05:35:40.794ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55172025-01-11T05:35:40.801ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 199.736802ms iteration = 28 status = {"physical_disks_added":0}
55182025-01-11T05:35:40.862ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45da3658-c046-43cc-a773-432610975d2d uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-11T05:35:40.862409013Z }
55192025-01-11T05:35:40.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45da3658-c046-43cc-a773-432610975d2d roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
55202025-01-11T05:35:40.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45da3658-c046-43cc-a773-432610975d2d resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
55212025-01-11T05:35:40.893ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55222025-01-11T05:35:40.899ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
55232025-01-11T05:35:40.899ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55242025-01-11T05:35:40.899ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22678839-ef9d-44fc-9100-6f10f1b6ec0a", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55252025-01-11T05:35:40.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55262025-01-11T05:35:40.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
55272025-01-11T05:35:40.918ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55282025-01-11T05:35:40.960ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55292025-01-11T05:35:40.960ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55302025-01-11T05:35:40.960ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "abec4b56-2855-4456-82c5-975924de69c8", "content-length": "583", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55312025-01-11T05:35:40.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55322025-01-11T05:35:40.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55332025-01-11T05:35:40.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/b77140eb-e3c3-4832-927b-a7e11c525031/state
55342025-01-11T05:35:40.995ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55352025-01-11T05:35:40.995ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "82755687-f0c2-4cb2-8b5a-8a1bf0b96f44", "content-length": "1", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55362025-01-11T05:35:40.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372025-01-11T05:35:40.997ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 395.12963ms iteration = 25 status = 0
55382025-01-11T05:35:40.997ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55392025-01-11T05:35:40.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55402025-01-11T05:35:40.999ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 397.115033ms iteration = 25 status = null
55412025-01-11T05:35:40.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55422025-01-11T05:35:40.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55432025-01-11T05:35:40.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55442025-01-11T05:35:41.001ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 399.932284ms iteration = 25 status = {}
55452025-01-11T05:35:41.002ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55462025-01-11T05:35:41.002ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55472025-01-11T05:35:41.002ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
55482025-01-11T05:35:41.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 400.505027ms iteration = 13 status = {"generation":1}
55492025-01-11T05:35:41.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144266 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45da3658-c046-43cc-a773-432610975d2d response_code = 204 uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
55502025-01-11T05:35:41.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b77140eb-e3c3-4832-927b-a7e11c525031/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "e994958a-41cc-4d14-a0fe-e75f00a581b9", "content-length": "131", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55512025-01-11T05:35:41.011ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f sled_id = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-11T05:35:40.862409013Z }, migration_in: None, migration_out: None } vmm_id = b77140eb-e3c3-4832-927b-a7e11c525031
55522025-01-11T05:35:41.011ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 sled_id = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd vmm_id = b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-11T05:35:40.862409013Z }
55532025-01-11T05:35:41.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f roles = RoleSet { roles: {} } sled_id = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd vmm_id = b77140eb-e3c3-4832-927b-a7e11c525031
55542025-01-11T05:35:41.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f resource = Database result = Ok(()) sled_id = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd vmm_id = b77140eb-e3c3-4832-927b-a7e11c525031
55552025-01-11T05:35:41.015ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {ed84f54c-8f8b-4e27-a706-b77e62b08959: {10.151.2.175: {1de6ae39-81cf-40c2-8b80-a5a9bebce457}, 10.151.2.176: {1de6ae39-81cf-40c2-8b80-a5a9bebce457}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55562025-01-11T05:35:41.015ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55572025-01-11T05:35:41.016ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5ae90919-42df-4291-be5f-06f191ffc668", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55582025-01-11T05:35:41.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55592025-01-11T05:35:41.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55602025-01-11T05:35:41.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55612025-01-11T05:35:41.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55622025-01-11T05:35:41.021ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
55632025-01-11T05:35:41.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 421.535868ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"stopping":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
55642025-01-11T05:35:41.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55652025-01-11T05:35:41.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55662025-01-11T05:35:41.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55672025-01-11T05:35:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55682025-01-11T05:35:41.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55692025-01-11T05:35:41.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55702025-01-11T05:35:41.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55712025-01-11T05:35:41.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55722025-01-11T05:35:41.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55732025-01-11T05:35:41.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55742025-01-11T05:35:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55752025-01-11T05:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55762025-01-11T05:35:41.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55772025-01-11T05:35:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55782025-01-11T05:35:41.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55792025-01-11T05:35:41.036ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55802025-01-11T05:35:41.036ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55812025-01-11T05:35:41.036ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55822025-01-11T05:35:41.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55832025-01-11T05:35:41.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55842025-01-11T05:35:41.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55852025-01-11T05:35:41.040ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b116ad64-8c19-4777-80c7-277bce21efca", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
55862025-01-11T05:35:41.042ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.049765ms iteration = 25 status = {}
55872025-01-11T05:35:41.136ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55882025-01-11T05:35:41.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 9a8ab097-28f7-4f22-a43b-2ad9da731229 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
55892025-01-11T05:35:41.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 9a8ab097-28f7-4f22-a43b-2ad9da731229 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
55902025-01-11T05:35:41.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 9a8ab097-28f7-4f22-a43b-2ad9da731229 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
55912025-01-11T05:35:41.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 7b3df3c7-0638-41fc-be08-625ab4ac7a4e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
55922025-01-11T05:35:41.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 7b3df3c7-0638-41fc-be08-625ab4ac7a4e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
55932025-01-11T05:35:41.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 7b3df3c7-0638-41fc-be08-625ab4ac7a4e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
55942025-01-11T05:35:41.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55952025-01-11T05:35:41.175ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8bb1c10e-3958-4ee8-b317-c59a8d048bac", "date": "Sat, 11 Jan 2025 05:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55962025-01-11T05:35:41.175ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55972025-01-11T05:35:41.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6896268c-1cb1-49ce-9799-05f4298e165c", "date": "Sat, 11 Jan 2025 05:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55982025-01-11T05:35:41.177ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55992025-01-11T05:35:41.179ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56002025-01-11T05:35:41.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 577.319607ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56012025-01-11T05:35:41.226ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56022025-01-11T05:35:41.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "70462c9c-596b-4265-b313-e6fa0a5d12ac", "content-length": "810", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
56032025-01-11T05:35:41.227ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(3640450) }} sled = sock
56042025-01-11T05:35:41.227ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56052025-01-11T05:35:41.227ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56062025-01-11T05:35:41.229ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 627.274052ms iteration = 25 status = {}
56072025-01-11T05:35:41.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56082025-01-11T05:35:41.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56092025-01-11T05:35:41.243ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56102025-01-11T05:35:41.243ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f7c8e6ab-5e85-4eee-a0db-4cad06f68344", "date": "Sat, 11 Jan 2025 05:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56112025-01-11T05:35:41.243ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56122025-01-11T05:35:41.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "06d8fca2-679f-48f1-9b3f-c48569eddef0", "date": "Sat, 11 Jan 2025 05:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56132025-01-11T05:35:41.245ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56142025-01-11T05:35:41.245ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
56152025-01-11T05:35:41.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56162025-01-11T05:35:41.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56172025-01-11T05:35:41.246ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "88c2593c-b43f-487e-903c-89a0515b1146", "date": "Sat, 11 Jan 2025 05:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56182025-01-11T05:35:41.246ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56192025-01-11T05:35:41.248ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56202025-01-11T05:35:41.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 646.086203ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56212025-01-11T05:35:41.257ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56222025-01-11T05:35:41.257ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "88fa258f-a4ba-4c3c-a2d6-8b89865b40a1", "content-length": "134", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
56232025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56242025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
56252025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56262025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56272025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56282025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56292025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56302025-01-11T05:35:41.257ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56312025-01-11T05:35:41.258ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56322025-01-11T05:35:41.258ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56332025-01-11T05:35:41.258ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
56342025-01-11T05:35:41.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56352025-01-11T05:35:41.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56362025-01-11T05:35:41.260ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56372025-01-11T05:35:41.260ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "00155b16-87e5-4849-9ede-f4b2779c4f94", "content-length": "2", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
56382025-01-11T05:35:41.260ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56392025-01-11T05:35:41.260ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "70322bdf-a79b-43d8-9924-e11c0e4822c1", "content-length": "52", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
56402025-01-11T05:35:41.260ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
56412025-01-11T05:35:41.260ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56422025-01-11T05:35:41.358ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7ab45ae4-24a7-4452-89af-332a7c7397df", "date": "Sat, 11 Jan 2025 05:35:40 GMT"} })
56432025-01-11T05:35:41.358ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
56442025-01-11T05:35:41.358ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56452025-01-11T05:35:41.359ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e56917-2cc9-4ef4-a245-a5b82bf35669", "content-length": "682", "date": "Sat, 11 Jan 2025 05:35:41 GMT"} })
56462025-01-11T05:35:41.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56472025-01-11T05:35:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56482025-01-11T05:35:41.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56492025-01-11T05:35:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56502025-01-11T05:35:41.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c1bb4bcf-221e-479a-8637-ed76289c5b89 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56512025-01-11T05:35:41.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c1bb4bcf-221e-479a-8637-ed76289c5b89 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56522025-01-11T05:35:41.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56532025-01-11T05:35:41.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56542025-01-11T05:35:41.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c1bb4bcf-221e-479a-8637-ed76289c5b89 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56552025-01-11T05:35:41.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56562025-01-11T05:35:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56572025-01-11T05:35:41.375ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 773.551423ms iteration = 25 status = {}
56582025-01-11T05:35:42.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f280de9-364f-4bf8-9e6a-8fafa6866b5e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56592025-01-11T05:35:42.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f280de9-364f-4bf8-9e6a-8fafa6866b5e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56602025-01-11T05:35:42.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f280de9-364f-4bf8-9e6a-8fafa6866b5e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56612025-01-11T05:35:43.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 3ae313a0-d3c8-4402-b308-f76b709253eb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
56622025-01-11T05:35:43.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 3ae313a0-d3c8-4402-b308-f76b709253eb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
56632025-01-11T05:35:43.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 3ae313a0-d3c8-4402-b308-f76b709253eb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
56642025-01-11T05:35:43.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45ee22cc-a06b-42eb-936c-bf1a3813f62b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56652025-01-11T05:35:43.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45ee22cc-a06b-42eb-936c-bf1a3813f62b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56662025-01-11T05:35:43.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 45ee22cc-a06b-42eb-936c-bf1a3813f62b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
56672025-01-11T05:35:43.501ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-11T05:35:43.501285298Z }
56682025-01-11T05:35:43.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56692025-01-11T05:35:43.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56702025-01-11T05:35:43.515ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_needs_update = true
56712025-01-11T05:35:43.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56722025-01-11T05:35:43.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56732025-01-11T05:35:43.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56742025-01-11T05:35:43.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56752025-01-11T05:35:43.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56762025-01-11T05:35:43.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56772025-01-11T05:35:43.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56782025-01-11T05:35:43.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56792025-01-11T05:35:43.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56802025-01-11T05:35:43.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56812025-01-11T05:35:43.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56822025-01-11T05:35:43.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56832025-01-11T05:35:43.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56842025-01-11T05:35:43.533ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, lookup_type: ById(8546ff28-6c6b-4dfc-933d-04ca6a8f7785) }, key: 9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa, lookup_type: ById(9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa) }, key: 2d234f16-d02c-467a-8c76-80da251d1e2f, lookup_type: ById(2d234f16-d02c-467a-8c76-80da251d1e2f) } result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56852025-01-11T05:35:43.546ZINFOnexus (dropshot_internal): starting update saga for 2d234f16-d02c-467a-8c76-80da251d1e2f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-11T05:35:43.501285298Z }
56862025-01-11T05:35:43.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45153 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e response_code = 204 uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56872025-01-11T05:35:43.546ZDEBGnexus (dropshot_internal): preparing instance-update saga for 2d234f16-d02c-467a-8c76-80da251d1e2f... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0ed58dac-6055-4438-a56f-919086266c2e uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56882025-01-11T05:35:43.546ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update
56892025-01-11T05:35:43.547ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e014b2d-d3a0-4b3a-8c39-d456417dccee uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-11T05:35:43.501285298Z }
56902025-01-11T05:35:43.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e014b2d-d3a0-4b3a-8c39-d456417dccee roles = RoleSet { roles: {} } uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56912025-01-11T05:35:43.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e014b2d-d3a0-4b3a-8c39-d456417dccee resource = Database result = Ok(()) uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56922025-01-11T05:35:43.548ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"2d234f16-d02c-467a-8c76-80da251d1e2f","lookup_type":{"ById":"2d234f16-d02c-467a-8c76-80da251d1e2f"},"parent":{"key":"9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa","lookup_type":{"ById":"9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa"},"parent":{"key":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","lookup_type":{"ById":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
56932025-01-11T05:35:43.548ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update
56942025-01-11T05:35:43.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6335 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1e014b2d-d3a0-4b3a-8c39-d456417dccee response_code = 204 uri = /vmms/b77140eb-e3c3-4832-927b-a7e11c525031
56952025-01-11T05:35:43.591ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update
56962025-01-11T05:35:43.591ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
56972025-01-11T05:35:43.591ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
56982025-01-11T05:35:43.594ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
56992025-01-11T05:35:43.598ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57002025-01-11T05:35:43.598ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
57012025-01-11T05:35:43.602ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57022025-01-11T05:35:43.602ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
57032025-01-11T05:35:43.608ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57042025-01-11T05:35:43.608ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cd58a412-e22d-4e8f-b00d-082cf0394bdb")) node_id = 0 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
57052025-01-11T05:35:43.612ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57062025-01-11T05:35:43.612ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
57072025-01-11T05:35:43.626ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update
57082025-01-11T05:35:43.630ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57092025-01-11T05:35:43.630ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57102025-01-11T05:35:43.632ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57112025-01-11T05:35:43.633ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57122025-01-11T05:35:43.634ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57132025-01-11T05:35:43.634ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57142025-01-11T05:35:43.636ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57152025-01-11T05:35:43.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57162025-01-11T05:35:43.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57172025-01-11T05:35:43.638ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57182025-01-11T05:35:43.639ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57192025-01-11T05:35:43.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57202025-01-11T05:35:43.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57212025-01-11T05:35:43.644ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, lookup_type: ById(8546ff28-6c6b-4dfc-933d-04ca6a8f7785) }, key: 9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa, lookup_type: ById(9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa) }, key: 2d234f16-d02c-467a-8c76-80da251d1e2f, lookup_type: ById(2d234f16-d02c-467a-8c76-80da251d1e2f) } result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57222025-01-11T05:35:43.646ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance updater_id = cd58a412-e22d-4e8f-b00d-082cf0394bdb
57232025-01-11T05:35:43.646ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57242025-01-11T05:35:43.647ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57252025-01-11T05:35:43.656ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance updater_id = cd58a412-e22d-4e8f-b00d-082cf0394bdb
57262025-01-11T05:35:43.656ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57272025-01-11T05:35:43.656ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance
57282025-01-11T05:35:43.660ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f locked_gen = Generation(Generation(2)) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = LockInstance updater_id = cd58a412-e22d-4e8f-b00d-082cf0394bdb
57292025-01-11T05:35:43.663ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57302025-01-11T05:35:43.663ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("cd58a412-e22d-4e8f-b00d-082cf0394bdb")}) node_id = 1 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
57312025-01-11T05:35:43.667ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57322025-01-11T05:35:43.667ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
57332025-01-11T05:35:43.675ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57342025-01-11T05:35:43.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57352025-01-11T05:35:43.676ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57362025-01-11T05:35:43.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57372025-01-11T05:35:43.678ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57382025-01-11T05:35:43.678ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57392025-01-11T05:35:43.679ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57402025-01-11T05:35:43.682ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, lookup_type: ById(8546ff28-6c6b-4dfc-933d-04ca6a8f7785) }, key: 9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa, lookup_type: ById(9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa) }, key: 2d234f16-d02c-467a-8c76-80da251d1e2f, lookup_type: ById(2d234f16-d02c-467a-8c76-80da251d1e2f) } result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57412025-01-11T05:35:43.682ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57422025-01-11T05:35:43.682ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
57432025-01-11T05:35:43.690ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b77140eb-e3c3-4832-927b-a7e11c525031, time_created: 2025-01-11T05:35:22.678383Z, time_deleted: None, instance_id: 2d234f16-d02c-467a-8c76-80da251d1e2f, sled_id: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-11T05:35:43.501285Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-11T05:35:19.536068Z, gen: Generation(Generation(3)), propolis_id: Some(b77140eb-e3c3-4832-927b-a7e11c525031), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b77140eb-e3c3-4832-927b-a7e11c525031 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-11T05:35:43.687986325Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
57442025-01-11T05:35:43.692ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
57452025-01-11T05:35:43.693ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"2d234f16-d02c-467a-8c76-80da251d1e2f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b77140eb-e3c3-4832-927b-a7e11c525031"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"2d234f16-d02c-467a-8c76-80da251d1e2f","lookup_type":{"ById":"2d234f16-d02c-467a-8c76-80da251d1e2f"},"parent":{"key":"9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa","lookup_type":{"ById":"9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa"},"parent":{"key":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","lookup_type":{"ById":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"cd58a412-e22d-4e8f-b00d-082cf0394bdb"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa","ram_diff":1073741824},"destroy_active_vmm":"b77140eb-e3c3-4832-927b-a7e11c525031","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-11T05:35:43.687986325Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57462025-01-11T05:35:43.693ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
57472025-01-11T05:35:43.697ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
57482025-01-11T05:35:43.698ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57492025-01-11T05:35:43.698ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57502025-01-11T05:35:43.698ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57512025-01-11T05:35:43.702ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57522025-01-11T05:35:43.702ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57532025-01-11T05:35:43.705ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57542025-01-11T05:35:43.705ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57552025-01-11T05:35:43.709ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57562025-01-11T05:35:43.709ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36")) node_id = 0 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57572025-01-11T05:35:43.713ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57582025-01-11T05:35:43.713ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57592025-01-11T05:35:43.719ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f parent_lock = UpdaterLock { updater_id: cd58a412-e22d-4e8f-b00d-082cf0394bdb, locked_gen: Generation(Generation(2)) } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
57602025-01-11T05:35:43.719ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = BecomeUpdater
57612025-01-11T05:35:43.720ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = BecomeUpdater
57622025-01-11T05:35:43.728ZDEBGnexus (SagaExecutor): inherited lock from cd58a412-e22d-4e8f-b00d-082cf0394bdb to 61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = cd58a412-e22d-4e8f-b00d-082cf0394bdb saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = BecomeUpdater updater_id = 61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36
57632025-01-11T05:35:43.730ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
57642025-01-11T05:35:43.730ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57652025-01-11T05:35:43.730ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36")}) node_id = 1 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57662025-01-11T05:35:43.733ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57672025-01-11T05:35:43.733ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57682025-01-11T05:35:43.737ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57692025-01-11T05:35:43.737ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57702025-01-11T05:35:43.740ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57712025-01-11T05:35:43.740ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
57722025-01-11T05:35:43.743ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
57732025-01-11T05:35:43.745ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f
57742025-01-11T05:35:43.746ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UpdateNetworkConfig
57752025-01-11T05:35:43.746ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UpdateNetworkConfig
57762025-01-11T05:35:43.750ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UpdateNetworkConfig
57772025-01-11T05:35:43.751ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UpdateNetworkConfig
57782025-01-11T05:35:43.755ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
57792025-01-11T05:35:43.755ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UpdateNetworkConfig
57802025-01-11T05:35:43.755ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UpdateNetworkConfig
57812025-01-11T05:35:43.757ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
57822025-01-11T05:35:43.757ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
57832025-01-11T05:35:43.758ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
57842025-01-11T05:35:43.759ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
57852025-01-11T05:35:43.760ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
57862025-01-11T05:35:43.760ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
57872025-01-11T05:35:43.760ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
57882025-01-11T05:35:43.764ZDEBGnexus: notifying dendrite of updates instance_id = Some(2d234f16-d02c-467a-8c76-80da251d1e2f (instance)) switch = switch0
57892025-01-11T05:35:43.765ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 321424710 } })
57902025-01-11T05:35:43.765ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
57912025-01-11T05:35:43.795ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
57922025-01-11T05:35:43.795ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57932025-01-11T05:35:43.796ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15ecbf01-ebc1-4d20-beaa-0fd9cbea3629", "content-length": "26", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} })
57942025-01-11T05:35:43.796ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57952025-01-11T05:35:43.798ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57962025-01-11T05:35:43.799ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3142 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 5b9771a3-a95d-4458-abe0-a9d64d2ac0be response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
57972025-01-11T05:35:43.828ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
57982025-01-11T05:35:43.828ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeaae002-bfd4-4b18-aa5e-d50626e9265f", "content-length": "4", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} })
57992025-01-11T05:35:43.829ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58002025-01-11T05:35:43.829ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58012025-01-11T05:35:43.833ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58022025-01-11T05:35:43.833ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58032025-01-11T05:35:43.837ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
58042025-01-11T05:35:43.837ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
58052025-01-11T05:35:43.910ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-11T05:35:43.842350Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, time_modified: Some(2025-01-11T05:35:43.842350Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa, time_modified: Some(2025-01-11T05:35:43.842350Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58062025-01-11T05:35:43.910ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58072025-01-11T05:35:43.910ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58082025-01-11T05:35:43.914ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58092025-01-11T05:35:43.914ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58102025-01-11T05:35:43.918ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58112025-01-11T05:35:43.918ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UnassignOximeterProducer
58122025-01-11T05:35:43.918ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UnassignOximeterProducer
58132025-01-11T05:35:43.923ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 68ba0762-4eeb-4568-8923-69d504e34a00 producer_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58142025-01-11T05:35:43.923ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UnassignOximeterProducer
58152025-01-11T05:35:43.923ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = UnassignOximeterProducer
58162025-01-11T05:35:43.963ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58172025-01-11T05:35:43.965ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/2d234f16-d02c-467a-8c76-80da251d1e2f
58182025-01-11T05:35:43.983ZDEBGnexus (SagaExecutor): client response oximeter-collector = 2d234f16-d02c-467a-8c76-80da251d1e2f result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/2d234f16-d02c-467a-8c76-80da251d1e2f", status: 204, headers: {"x-request-id": "be5e570f-4462-464e-91b6-5a625256af80", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} }) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58192025-01-11T05:35:43.983ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 68ba0762-4eeb-4568-8923-69d504e34a00 producer_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58202025-01-11T05:35:43.984ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58212025-01-11T05:35:43.984ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58222025-01-11T05:35:43.991ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58232025-01-11T05:35:43.991ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58242025-01-11T05:35:43.996ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f lock = UpdaterLock { updater_id: 61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-11T05:35:43.687986325Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58252025-01-11T05:35:43.996ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = CommitInstanceUpdates
58262025-01-11T05:35:43.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = CommitInstanceUpdates
58272025-01-11T05:35:44.038ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f new_runtime = InstanceRuntimeState { time_updated: 2025-01-11T05:35:43.687986325Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58282025-01-11T05:35:44.038ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58292025-01-11T05:35:44.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58302025-01-11T05:35:44.038ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
58312025-01-11T05:35:44.038ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58322025-01-11T05:35:44.038ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
58332025-01-11T05:35:44.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58342025-01-11T05:35:44.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58352025-01-11T05:35:44.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58362025-01-11T05:35:44.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58372025-01-11T05:35:44.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58382025-01-11T05:35:44.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58392025-01-11T05:35:44.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58402025-01-11T05:35:44.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58412025-01-11T05:35:44.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58422025-01-11T05:35:44.045ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58432025-01-11T05:35:44.045ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58442025-01-11T05:35:44.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58452025-01-11T05:35:44.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58462025-01-11T05:35:44.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58472025-01-11T05:35:44.050ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58482025-01-11T05:35:44.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("2d234f16-d02c-467a-8c76-80da251d1e2f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b77140eb-e3c3-4832-927b-a7e11c525031")}) node_id = 7 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58492025-01-11T05:35:44.053ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58502025-01-11T05:35:44.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58512025-01-11T05:35:44.057ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58522025-01-11T05:35:44.057ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58532025-01-11T05:35:44.062ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58542025-01-11T05:35:44.062ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58552025-01-11T05:35:44.066ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
58562025-01-11T05:35:44.066ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ReleaseSledResources
58572025-01-11T05:35:44.066ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ReleaseSledResources
58582025-01-11T05:35:44.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58592025-01-11T05:35:44.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58602025-01-11T05:35:44.078ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58612025-01-11T05:35:44.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58622025-01-11T05:35:44.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c529b014-ecbb-4340-91a4-1b94e264b876", "content-length": "372", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} })
58632025-01-11T05:35:44.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58642025-01-11T05:35:44.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58652025-01-11T05:35:44.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58662025-01-11T05:35:44.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58672025-01-11T05:35:44.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682025-01-11T05:35:44.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58692025-01-11T05:35:44.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58702025-01-11T05:35:44.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58712025-01-11T05:35:44.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58722025-01-11T05:35:44.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58732025-01-11T05:35:44.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58742025-01-11T05:35:44.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58752025-01-11T05:35:44.094ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {ed84f54c-8f8b-4e27-a706-b77e62b08959: {10.151.2.176: {1de6ae39-81cf-40c2-8b80-a5a9bebce457}, 10.151.2.175: {1de6ae39-81cf-40c2-8b80-a5a9bebce457}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58762025-01-11T05:35:44.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58772025-01-11T05:35:44.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b0175bb3-d9c4-4bb1-ba5d-a3136d8be701", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} })
58782025-01-11T05:35:44.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58792025-01-11T05:35:44.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58802025-01-11T05:35:44.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58812025-01-11T05:35:44.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58822025-01-11T05:35:44.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58832025-01-11T05:35:44.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58842025-01-11T05:35:44.101ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58852025-01-11T05:35:44.101ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58862025-01-11T05:35:44.101ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3d7a173-e1cd-42e3-bf8c-ce1d4e732d85", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} })
58872025-01-11T05:35:44.103ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 65.674377ms iteration = 26 status = {}
58882025-01-11T05:35:44.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58892025-01-11T05:35:44.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4d23c73-1fc3-4d7a-83b2-4849ff6eee43", "content-length": "691", "date": "Sat, 11 Jan 2025 05:35:43 GMT"} })
58902025-01-11T05:35:44.125ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58912025-01-11T05:35:44.125ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58922025-01-11T05:35:44.125ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58932025-01-11T05:35:44.127ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 89.692233ms iteration = 26 status = {}
58942025-01-11T05:35:44.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 8598c49c-fef0-4493-9d03-cb30f270d95f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
58952025-01-11T05:35:44.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 8598c49c-fef0-4493-9d03-cb30f270d95f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
58962025-01-11T05:35:44.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 8598c49c-fef0-4493-9d03-cb30f270d95f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
58972025-01-11T05:35:44.183ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
58982025-01-11T05:35:44.183ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
58992025-01-11T05:35:44.187ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59002025-01-11T05:35:44.187ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59012025-01-11T05:35:44.190ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f propolis_id = b77140eb-e3c3-4832-927b-a7e11c525031 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
59022025-01-11T05:35:44.190ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = MarkVmmDeleted
59032025-01-11T05:35:44.191ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = MarkVmmDeleted
59042025-01-11T05:35:44.198ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59052025-01-11T05:35:44.198ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59062025-01-11T05:35:44.202ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59072025-01-11T05:35:44.202ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59082025-01-11T05:35:44.205ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59092025-01-11T05:35:44.205ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59102025-01-11T05:35:44.208ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59112025-01-11T05:35:44.208ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59122025-01-11T05:35:44.211ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59132025-01-11T05:35:44.211ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59142025-01-11T05:35:44.212ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59152025-01-11T05:35:44.212ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59162025-01-11T05:35:44.214ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59172025-01-11T05:35:44.214ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59182025-01-11T05:35:44.215ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59192025-01-11T05:35:44.219ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, lookup_type: ById(8546ff28-6c6b-4dfc-933d-04ca6a8f7785) }, key: 9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa, lookup_type: ById(9ba9a90c-c83a-4d69-9187-6c1d2dbf6baa) }, key: 2d234f16-d02c-467a-8c76-80da251d1e2f, lookup_type: ById(2d234f16-d02c-467a-8c76-80da251d1e2f) } result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59202025-01-11T05:35:44.219ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59212025-01-11T05:35:44.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_node = ChainSuccessorSaga
59222025-01-11T05:35:44.224ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f karmic_state = WillReincarnate needs_reincarnation = false saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update
59232025-01-11T05:35:44.224ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59242025-01-11T05:35:44.224ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59252025-01-11T05:35:44.227ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59262025-01-11T05:35:44.227ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59272025-01-11T05:35:44.230ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59282025-01-11T05:35:44.230ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59292025-01-11T05:35:44.234ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59302025-01-11T05:35:44.234ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565
59312025-01-11T05:35:44.241ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59322025-01-11T05:35:44.241ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 saga_name = instance-update saga_result = SagaResult { saga_id: f5d1aa73-7a30-4d59-9889-480b0c882565, saga_log: SagaLog { saga_id: f5d1aa73-7a30-4d59-9889-480b0c882565, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("2d234f16-d02c-467a-8c76-80da251d1e2f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b77140eb-e3c3-4832-927b-a7e11c525031")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("2d234f16-d02c-467a-8c76-80da251d1e2f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b77140eb-e3c3-4832-927b-a7e11c525031")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("61e18ac0-dd52-48a8-9d3d-56a7dfd8cc36")}} }) }
59332025-01-11T05:35:44.241ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = f5d1aa73-7a30-4d59-9889-480b0c882565 instance_id = 2d234f16-d02c-467a-8c76-80da251d1e2f saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update
59342025-01-11T05:35:44.241ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59352025-01-11T05:35:44.241ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
59362025-01-11T05:35:44.245ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59372025-01-11T05:35:44.245ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
59382025-01-11T05:35:44.247ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59392025-01-11T05:35:44.247ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
59402025-01-11T05:35:44.251ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59412025-01-11T05:35:44.251ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75
59422025-01-11T05:35:44.283ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update sec_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
59432025-01-11T05:35:44.283ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e8f45167-b874-4d1a-afa4-c868c7acfa75 saga_name = start-instance-update saga_result = SagaResult { saga_id: e8f45167-b874-4d1a-afa4-c868c7acfa75, saga_log: SagaLog { saga_id: e8f45167-b874-4d1a-afa4-c868c7acfa75, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("cd58a412-e22d-4e8f-b00d-082cf0394bdb")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("cd58a412-e22d-4e8f-b00d-082cf0394bdb")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("cd58a412-e22d-4e8f-b00d-082cf0394bdb"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("cd58a412-e22d-4e8f-b00d-082cf0394bdb")}} }) }
59442025-01-11T05:35:44.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f076c5e3-6084-4c3b-ad10-0ad3d57f0af1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59452025-01-11T05:35:44.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f076c5e3-6084-4c3b-ad10-0ad3d57f0af1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59462025-01-11T05:35:44.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f076c5e3-6084-4c3b-ad10-0ad3d57f0af1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59472025-01-11T05:35:45.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4df922c4-f9e1-45f0-b017-573ba4c675f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
59482025-01-11T05:35:45.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4df922c4-f9e1-45f0-b017-573ba4c675f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
59492025-01-11T05:35:45.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4df922c4-f9e1-45f0-b017-573ba4c675f2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
59502025-01-11T05:35:45.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 66e55c1d-4e8d-4a24-9ef4-874df7efe1a8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59512025-01-11T05:35:45.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 66e55c1d-4e8d-4a24-9ef4-874df7efe1a8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59522025-01-11T05:35:45.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 66e55c1d-4e8d-4a24-9ef4-874df7efe1a8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59532025-01-11T05:35:46.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3483bb9d-f8ac-40f6-99b8-927a3ef24b2c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59542025-01-11T05:35:46.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3483bb9d-f8ac-40f6-99b8-927a3ef24b2c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59552025-01-11T05:35:46.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3483bb9d-f8ac-40f6-99b8-927a3ef24b2c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59562025-01-11T05:35:47.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 83869de2-1caa-4473-9d89-fe599bf9c92c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59572025-01-11T05:35:47.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 83869de2-1caa-4473-9d89-fe599bf9c92c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59582025-01-11T05:35:47.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 83869de2-1caa-4473-9d89-fe599bf9c92c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59592025-01-11T05:35:48.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 67b180b0-e583-4351-99a1-635c5c370990 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59602025-01-11T05:35:48.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 67b180b0-e583-4351-99a1-635c5c370990 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59612025-01-11T05:35:48.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 67b180b0-e583-4351-99a1-635c5c370990 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59622025-01-11T05:35:49.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = acf62abc-6a9b-4858-86f9-79e0a0a61374 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59632025-01-11T05:35:49.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = acf62abc-6a9b-4858-86f9-79e0a0a61374 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59642025-01-11T05:35:49.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = acf62abc-6a9b-4858-86f9-79e0a0a61374 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59652025-01-11T05:35:50.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 599702ea-3dbb-4988-bc0b-cccf94f4d950 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59662025-01-11T05:35:50.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 599702ea-3dbb-4988-bc0b-cccf94f4d950 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59672025-01-11T05:35:50.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 599702ea-3dbb-4988-bc0b-cccf94f4d950 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59682025-01-11T05:35:50.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
59692025-01-11T05:35:50.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
59702025-01-11T05:35:50.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59712025-01-11T05:35:50.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59722025-01-11T05:35:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59732025-01-11T05:35:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59742025-01-11T05:35:50.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59752025-01-11T05:35:50.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59762025-01-11T05:35:50.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59772025-01-11T05:35:50.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.776405ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59782025-01-11T05:35:50.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59792025-01-11T05:35:50.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59802025-01-11T05:35:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59812025-01-11T05:35:50.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59822025-01-11T05:35:50.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59832025-01-11T05:35:50.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59842025-01-11T05:35:50.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
59852025-01-11T05:35:50.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59862025-01-11T05:35:50.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59872025-01-11T05:35:50.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
59882025-01-11T05:35:50.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.644101ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
59892025-01-11T05:35:51.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 89579143-3f6f-4655-b724-27416c58cb9f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59902025-01-11T05:35:51.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 89579143-3f6f-4655-b724-27416c58cb9f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59912025-01-11T05:35:51.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 89579143-3f6f-4655-b724-27416c58cb9f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59922025-01-11T05:35:52.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d08d9e96-8f65-4631-aa9b-7e32a1c9b94c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59932025-01-11T05:35:52.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d08d9e96-8f65-4631-aa9b-7e32a1c9b94c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59942025-01-11T05:35:52.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d08d9e96-8f65-4631-aa9b-7e32a1c9b94c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59952025-01-11T05:35:53.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51e69322-ec25-4301-a5c7-1b89a52c9a96 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59962025-01-11T05:35:53.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51e69322-ec25-4301-a5c7-1b89a52c9a96 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59972025-01-11T05:35:53.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 51e69322-ec25-4301-a5c7-1b89a52c9a96 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
59982025-01-11T05:35:53.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 3f5f7185-d4a7-4f2a-8eda-2e83e2789786 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
59992025-01-11T05:35:53.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 3f5f7185-d4a7-4f2a-8eda-2e83e2789786 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
60002025-01-11T05:35:53.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 3f5f7185-d4a7-4f2a-8eda-2e83e2789786 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
60012025-01-11T05:35:53.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 0163af20-0213-41a9-bfc4-21b0afd0fb09 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
60022025-01-11T05:35:53.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 0163af20-0213-41a9-bfc4-21b0afd0fb09 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
60032025-01-11T05:35:53.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 0163af20-0213-41a9-bfc4-21b0afd0fb09 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
60042025-01-11T05:35:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 631 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = caf87581-c504-4d66-9dce-092ede78afdf response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
60052025-01-11T05:35:54.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 548e1a19-9f0e-4120-9e5a-aa054ce7640a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60062025-01-11T05:35:54.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 548e1a19-9f0e-4120-9e5a-aa054ce7640a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60072025-01-11T05:35:54.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 548e1a19-9f0e-4120-9e5a-aa054ce7640a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60082025-01-11T05:35:55.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e1420ec-7225-45af-93ad-47495eb2804a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60092025-01-11T05:35:55.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e1420ec-7225-45af-93ad-47495eb2804a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60102025-01-11T05:35:55.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e1420ec-7225-45af-93ad-47495eb2804a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60112025-01-11T05:35:56.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 80945508-0c7a-4b47-b29e-86600ca97dd5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60122025-01-11T05:35:56.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 80945508-0c7a-4b47-b29e-86600ca97dd5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60132025-01-11T05:35:56.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 80945508-0c7a-4b47-b29e-86600ca97dd5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60142025-01-11T05:35:57.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 93795a84-3fd2-492e-8005-1ca2720a5bcf roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60152025-01-11T05:35:57.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 93795a84-3fd2-492e-8005-1ca2720a5bcf resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60162025-01-11T05:35:57.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 93795a84-3fd2-492e-8005-1ca2720a5bcf response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60172025-01-11T05:35:58.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a90248e-1aaa-4bab-b550-c93be12eff0d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60182025-01-11T05:35:58.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a90248e-1aaa-4bab-b550-c93be12eff0d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60192025-01-11T05:35:58.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4a90248e-1aaa-4bab-b550-c93be12eff0d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60202025-01-11T05:35:59.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b02d15eb-530a-4f03-95de-339057c8b57b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60212025-01-11T05:35:59.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b02d15eb-530a-4f03-95de-339057c8b57b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60222025-01-11T05:35:59.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b02d15eb-530a-4f03-95de-339057c8b57b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60232025-01-11T05:36:00.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
60242025-01-11T05:36:00.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
60252025-01-11T05:36:00.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60262025-01-11T05:36:00.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60272025-01-11T05:36:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60282025-01-11T05:36:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60292025-01-11T05:36:00.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60302025-01-11T05:36:00.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60312025-01-11T05:36:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60322025-01-11T05:36:00.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.153603ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60332025-01-11T05:36:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60342025-01-11T05:36:00.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60352025-01-11T05:36:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60362025-01-11T05:36:00.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60372025-01-11T05:36:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60382025-01-11T05:36:00.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60392025-01-11T05:36:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
60402025-01-11T05:36:00.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60412025-01-11T05:36:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60422025-01-11T05:36:00.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
60432025-01-11T05:36:00.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.634521ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
60442025-01-11T05:36:00.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05455eea-687f-4059-9d86-8095f7627925 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60452025-01-11T05:36:00.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05455eea-687f-4059-9d86-8095f7627925 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60462025-01-11T05:36:00.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 05455eea-687f-4059-9d86-8095f7627925 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60472025-01-11T05:36:01.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e24c4b6-f367-4d3b-99e9-c392a891c998 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60482025-01-11T05:36:01.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e24c4b6-f367-4d3b-99e9-c392a891c998 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60492025-01-11T05:36:01.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e24c4b6-f367-4d3b-99e9-c392a891c998 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60502025-01-11T05:36:02.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5663dec8-2f89-4ac0-8b30-f23fcc9b17cf roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60512025-01-11T05:36:02.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5663dec8-2f89-4ac0-8b30-f23fcc9b17cf resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60522025-01-11T05:36:02.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5663dec8-2f89-4ac0-8b30-f23fcc9b17cf response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60532025-01-11T05:36:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 766 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 1d870f22-892e-40eb-9ed7-2ce59a51b578 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
60542025-01-11T05:36:03.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e36d151-4327-45b8-bfcb-c02d55c53306 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60552025-01-11T05:36:03.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e36d151-4327-45b8-bfcb-c02d55c53306 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60562025-01-11T05:36:03.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7e36d151-4327-45b8-bfcb-c02d55c53306 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60572025-01-11T05:36:04.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 22450ca0-0847-43e7-97ad-d3f637130f4d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60582025-01-11T05:36:04.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 22450ca0-0847-43e7-97ad-d3f637130f4d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60592025-01-11T05:36:04.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 22450ca0-0847-43e7-97ad-d3f637130f4d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60602025-01-11T05:36:05.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 43cf5f0c-126e-4976-9582-dcebaabbb53d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60612025-01-11T05:36:05.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 43cf5f0c-126e-4976-9582-dcebaabbb53d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60622025-01-11T05:36:05.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 43cf5f0c-126e-4976-9582-dcebaabbb53d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60632025-01-11T05:36:06.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = af3e8fbc-c399-4b98-bfeb-b2dc5fb63e15 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60642025-01-11T05:36:06.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = af3e8fbc-c399-4b98-bfeb-b2dc5fb63e15 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60652025-01-11T05:36:06.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = af3e8fbc-c399-4b98-bfeb-b2dc5fb63e15 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60662025-01-11T05:36:07.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b2b0c36c-68e2-47bf-bc3e-f3ed6a5ba94b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60672025-01-11T05:36:07.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b2b0c36c-68e2-47bf-bc3e-f3ed6a5ba94b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60682025-01-11T05:36:07.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b2b0c36c-68e2-47bf-bc3e-f3ed6a5ba94b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60692025-01-11T05:36:08.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de020cc2-0485-4915-bddc-95070e004ddd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60702025-01-11T05:36:08.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de020cc2-0485-4915-bddc-95070e004ddd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60712025-01-11T05:36:08.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de020cc2-0485-4915-bddc-95070e004ddd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60722025-01-11T05:36:09.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4e859379-4f9c-4246-988a-6a0cfde36392 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60732025-01-11T05:36:09.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4e859379-4f9c-4246-988a-6a0cfde36392 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60742025-01-11T05:36:09.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4e859379-4f9c-4246-988a-6a0cfde36392 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
60752025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
60762025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
60772025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60782025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60792025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
60802025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60812025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
60822025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
60832025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60842025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60852025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60862025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
60872025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
60882025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60892025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60902025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
60912025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60922025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
60932025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
60942025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60952025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
60962025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
60972025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60982025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60992025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
61002025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61012025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
61022025-01-11T05:36:10.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61032025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
61042025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61052025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61062025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
61072025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
61082025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61092025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61102025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61112025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61122025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61132025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61142025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61152025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61162025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61172025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61182025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61192025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61202025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61212025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61222025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61232025-01-11T05:36:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61242025-01-11T05:36:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61252025-01-11T05:36:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61262025-01-11T05:36:10.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61272025-01-11T05:36:10.606ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61282025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61292025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61302025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.889795ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61312025-01-11T05:36:10.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1710, tv_nsec: 162522425 } })
61322025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61332025-01-11T05:36:10.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
61342025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61352025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61362025-01-11T05:36:10.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61372025-01-11T05:36:10.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61382025-01-11T05:36:10.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61392025-01-11T05:36:10.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61402025-01-11T05:36:10.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61412025-01-11T05:36:10.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1710, tv_nsec: 166551053 } })
61422025-01-11T05:36:10.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61432025-01-11T05:36:10.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61442025-01-11T05:36:10.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
61452025-01-11T05:36:10.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61462025-01-11T05:36:10.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61472025-01-11T05:36:10.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482025-01-11T05:36:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61492025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61502025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61512025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61522025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61532025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61542025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61552025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61562025-01-11T05:36:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61572025-01-11T05:36:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61582025-01-11T05:36:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61592025-01-11T05:36:10.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61602025-01-11T05:36:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61612025-01-11T05:36:10.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61622025-01-11T05:36:10.617ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61632025-01-11T05:36:10.617ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61642025-01-11T05:36:10.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61652025-01-11T05:36:10.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61662025-01-11T05:36:10.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1710, tv_nsec: 174560359 } })
61672025-01-11T05:36:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61682025-01-11T05:36:10.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61692025-01-11T05:36:10.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
61702025-01-11T05:36:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61712025-01-11T05:36:10.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61722025-01-11T05:36:10.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61732025-01-11T05:36:10.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61742025-01-11T05:36:10.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61752025-01-11T05:36:10.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762025-01-11T05:36:10.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61772025-01-11T05:36:10.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61782025-01-11T05:36:10.622ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61792025-01-11T05:36:10.622ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61802025-01-11T05:36:10.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 20.270664ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61812025-01-11T05:36:10.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61822025-01-11T05:36:10.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61832025-01-11T05:36:10.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61842025-01-11T05:36:10.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61852025-01-11T05:36:10.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61862025-01-11T05:36:10.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61872025-01-11T05:36:10.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61882025-01-11T05:36:10.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61892025-01-11T05:36:10.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
61902025-01-11T05:36:10.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61912025-01-11T05:36:10.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61922025-01-11T05:36:10.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.047124ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
61932025-01-11T05:36:10.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.057928ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
61942025-01-11T05:36:10.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61952025-01-11T05:36:10.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61962025-01-11T05:36:10.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61972025-01-11T05:36:10.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61982025-01-11T05:36:10.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61992025-01-11T05:36:10.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62002025-01-11T05:36:10.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.707846ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62012025-01-11T05:36:10.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62022025-01-11T05:36:10.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62032025-01-11T05:36:10.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042025-01-11T05:36:10.649ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
62052025-01-11T05:36:10.649ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.394037ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
62062025-01-11T05:36:10.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.617152ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62072025-01-11T05:36:10.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
62082025-01-11T05:36:10.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62092025-01-11T05:36:10.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62102025-01-11T05:36:10.657ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.712638ms iteration = 26 status = 0
62112025-01-11T05:36:10.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.200443ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62122025-01-11T05:36:10.666ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62132025-01-11T05:36:10.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.194475ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
62142025-01-11T05:36:10.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.739968ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62152025-01-11T05:36:10.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62162025-01-11T05:36:10.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62172025-01-11T05:36:10.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62182025-01-11T05:36:10.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62192025-01-11T05:36:10.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202025-01-11T05:36:10.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62212025-01-11T05:36:10.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62222025-01-11T05:36:10.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62232025-01-11T05:36:10.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62242025-01-11T05:36:10.717ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62252025-01-11T05:36:10.718ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a31a85-babf-4aa9-9f83-3a69f35ce2d4", "content-length": "26", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62262025-01-11T05:36:10.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62272025-01-11T05:36:10.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62282025-01-11T05:36:10.736ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.264219ms iteration = 29 status = {"physical_disks_added":0}
62292025-01-11T05:36:10.801ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62302025-01-11T05:36:10.801ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62312025-01-11T05:36:10.801ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbea48d5-4698-4f37-8bbb-bdc2f540bd6b", "content-length": "26", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62322025-01-11T05:36:10.801ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62332025-01-11T05:36:10.802ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62342025-01-11T05:36:10.809ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62352025-01-11T05:36:10.809ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62362025-01-11T05:36:10.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d36172-33e0-4c3e-9424-2b1941d39909", "content-length": "372", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62372025-01-11T05:36:10.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62382025-01-11T05:36:10.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62392025-01-11T05:36:10.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62402025-01-11T05:36:10.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62412025-01-11T05:36:10.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62422025-01-11T05:36:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62432025-01-11T05:36:10.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
62442025-01-11T05:36:10.818ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62452025-01-11T05:36:10.818ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "218e4549-b9eb-40a0-b9c9-c7350a7f754b", "content-length": "26", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62462025-01-11T05:36:10.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62472025-01-11T05:36:10.819ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
62482025-01-11T05:36:10.829ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 227.402848ms iteration = 26 status = {}
62492025-01-11T05:36:10.853ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62502025-01-11T05:36:10.853ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62512025-01-11T05:36:10.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27720ec4-35cf-4b96-94e3-950542c78a20", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62522025-01-11T05:36:10.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62532025-01-11T05:36:10.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62542025-01-11T05:36:10.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62552025-01-11T05:36:10.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62562025-01-11T05:36:10.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62572025-01-11T05:36:10.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62582025-01-11T05:36:10.862ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62592025-01-11T05:36:10.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62602025-01-11T05:36:10.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "497d8949-5a6b-4d02-8d5e-37aa6ead8763", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62612025-01-11T05:36:10.864ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 262.130159ms iteration = 27 status = {}
62622025-01-11T05:36:10.871ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62632025-01-11T05:36:10.871ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "44ff03ae-06df-4ef3-8b2c-4a05d42cfd66", "content-length": "2", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62642025-01-11T05:36:10.873ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62652025-01-11T05:36:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62662025-01-11T05:36:10.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62672025-01-11T05:36:10.935ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a39f7fd5-545e-465a-a552-76a2fcf4e9f9", "content-length": "691", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62682025-01-11T05:36:10.935ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62692025-01-11T05:36:10.935ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62702025-01-11T05:36:10.935ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62712025-01-11T05:36:10.937ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 334.985763ms iteration = 26 status = null
62722025-01-11T05:36:10.937ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 335.376431ms iteration = 27 status = {}
62732025-01-11T05:36:10.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62742025-01-11T05:36:10.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62752025-01-11T05:36:10.973ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
62762025-01-11T05:36:10.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62772025-01-11T05:36:10.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62782025-01-11T05:36:10.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62792025-01-11T05:36:10.982ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a11c409-bf16-40fb-9a37-cef28ccb5bf0", "content-length": "134", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62802025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62812025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
62822025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62832025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62842025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62852025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62862025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62872025-01-11T05:36:10.982ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62882025-01-11T05:36:10.983ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62892025-01-11T05:36:10.983ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62902025-01-11T05:36:10.983ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
62912025-01-11T05:36:10.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62922025-01-11T05:36:10.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62932025-01-11T05:36:10.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62942025-01-11T05:36:10.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f5cd859-5b13-4e73-8376-e50e62fb8608", "content-length": "2", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62952025-01-11T05:36:10.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62962025-01-11T05:36:10.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0624833-72ad-4833-b6c1-a83ce0476c14", "content-length": "52", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
62972025-01-11T05:36:10.990ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
62982025-01-11T05:36:10.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62992025-01-11T05:36:11.087ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2328f34-d8c9-4b88-955c-446939611699", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
63002025-01-11T05:36:11.087ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
63012025-01-11T05:36:11.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63022025-01-11T05:36:11.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d317bf3f-afbd-481f-85f8-bb0c2abcb030 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63032025-01-11T05:36:11.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d317bf3f-afbd-481f-85f8-bb0c2abcb030 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63042025-01-11T05:36:11.087ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a51a961-54f6-4d00-96e5-c959092d91c3", "content-length": "682", "date": "Sat, 11 Jan 2025 05:36:10 GMT"} })
63052025-01-11T05:36:11.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63062025-01-11T05:36:11.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63072025-01-11T05:36:11.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d317bf3f-afbd-481f-85f8-bb0c2abcb030 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63082025-01-11T05:36:11.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63092025-01-11T05:36:11.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63102025-01-11T05:36:11.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63112025-01-11T05:36:11.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63122025-01-11T05:36:11.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63132025-01-11T05:36:11.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63142025-01-11T05:36:11.103ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.308663ms iteration = 26 status = {}
63152025-01-11T05:36:12.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ebfab41b-63d1-4e6e-8e53-fe5f1318e900 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63162025-01-11T05:36:12.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ebfab41b-63d1-4e6e-8e53-fe5f1318e900 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63172025-01-11T05:36:12.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ebfab41b-63d1-4e6e-8e53-fe5f1318e900 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63182025-01-11T05:36:13.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cbf8c619-8efe-48e4-9f70-8254d00da4b1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63192025-01-11T05:36:13.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cbf8c619-8efe-48e4-9f70-8254d00da4b1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63202025-01-11T05:36:13.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cbf8c619-8efe-48e4-9f70-8254d00da4b1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63212025-01-11T05:36:13.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 679 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = b3af3c80-a6eb-4937-875f-3a1dc6a4b757 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
63222025-01-11T05:36:14.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 69da5178-34a0-4ddb-b4d3-62af4d3efb1a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63232025-01-11T05:36:14.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 69da5178-34a0-4ddb-b4d3-62af4d3efb1a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63242025-01-11T05:36:14.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 69da5178-34a0-4ddb-b4d3-62af4d3efb1a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63252025-01-11T05:36:15.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5804ce6-4f8e-4e67-984b-742ceaf320c1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63262025-01-11T05:36:15.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5804ce6-4f8e-4e67-984b-742ceaf320c1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63272025-01-11T05:36:15.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5804ce6-4f8e-4e67-984b-742ceaf320c1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63282025-01-11T05:36:15.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4faab08a-d7fb-4b37-94b0-8a4caa28ddaa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
63292025-01-11T05:36:15.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4faab08a-d7fb-4b37-94b0-8a4caa28ddaa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
63302025-01-11T05:36:15.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 4faab08a-d7fb-4b37-94b0-8a4caa28ddaa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
63312025-01-11T05:36:16.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a259c714-8f97-4fa2-9c63-e3d8e672af2f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63322025-01-11T05:36:16.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a259c714-8f97-4fa2-9c63-e3d8e672af2f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63332025-01-11T05:36:16.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a259c714-8f97-4fa2-9c63-e3d8e672af2f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63342025-01-11T05:36:17.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 750cc52d-6f94-4a25-a93f-008d2ca057a3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63352025-01-11T05:36:17.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 750cc52d-6f94-4a25-a93f-008d2ca057a3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63362025-01-11T05:36:17.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 750cc52d-6f94-4a25-a93f-008d2ca057a3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63372025-01-11T05:36:18.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0163718a-58db-467a-9efe-e37464d404cf roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63382025-01-11T05:36:18.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0163718a-58db-467a-9efe-e37464d404cf resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63392025-01-11T05:36:18.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0163718a-58db-467a-9efe-e37464d404cf response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63402025-01-11T05:36:19.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7bfae47c-ccae-4fa9-860f-f7928384362a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63412025-01-11T05:36:19.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7bfae47c-ccae-4fa9-860f-f7928384362a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63422025-01-11T05:36:19.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7bfae47c-ccae-4fa9-860f-f7928384362a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63432025-01-11T05:36:20.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 211f77e6-5154-41c6-8d38-08814c287c09 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63442025-01-11T05:36:20.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 211f77e6-5154-41c6-8d38-08814c287c09 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63452025-01-11T05:36:20.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 211f77e6-5154-41c6-8d38-08814c287c09 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63462025-01-11T05:36:20.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
63472025-01-11T05:36:20.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
63482025-01-11T05:36:20.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63492025-01-11T05:36:20.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63502025-01-11T05:36:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63512025-01-11T05:36:20.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63522025-01-11T05:36:20.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63532025-01-11T05:36:20.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63542025-01-11T05:36:20.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63552025-01-11T05:36:20.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63562025-01-11T05:36:20.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63572025-01-11T05:36:20.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63582025-01-11T05:36:20.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63592025-01-11T05:36:20.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63602025-01-11T05:36:20.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612025-01-11T05:36:20.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
63622025-01-11T05:36:20.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63632025-01-11T05:36:20.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63642025-01-11T05:36:20.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
63652025-01-11T05:36:20.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.937902ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
63662025-01-11T05:36:20.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.981233ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63672025-01-11T05:36:21.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8640755b-8916-427c-9ea0-10fd8e7bd457 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63682025-01-11T05:36:21.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8640755b-8916-427c-9ea0-10fd8e7bd457 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63692025-01-11T05:36:21.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8640755b-8916-427c-9ea0-10fd8e7bd457 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63702025-01-11T05:36:22.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8806ee0e-fa0b-4a06-aad7-f3419d29d911 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63712025-01-11T05:36:22.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8806ee0e-fa0b-4a06-aad7-f3419d29d911 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63722025-01-11T05:36:22.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8806ee0e-fa0b-4a06-aad7-f3419d29d911 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63732025-01-11T05:36:23.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4afbb9e4-c894-438d-a516-e1f3b363b2ca roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63742025-01-11T05:36:23.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4afbb9e4-c894-438d-a516-e1f3b363b2ca resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63752025-01-11T05:36:23.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4afbb9e4-c894-438d-a516-e1f3b363b2ca response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63762025-01-11T05:36:23.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = ae6d4d88-b419-490c-b913-bf6e940fc98c roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
63772025-01-11T05:36:23.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = ae6d4d88-b419-490c-b913-bf6e940fc98c resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
63782025-01-11T05:36:23.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = ae6d4d88-b419-490c-b913-bf6e940fc98c response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
63792025-01-11T05:36:23.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 9dfe6ee8-8b45-4a05-b65d-2ed11c663920 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
63802025-01-11T05:36:23.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 9dfe6ee8-8b45-4a05-b65d-2ed11c663920 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
63812025-01-11T05:36:23.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 9dfe6ee8-8b45-4a05-b65d-2ed11c663920 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
63822025-01-11T05:36:23.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 226b00a3-d2db-45ca-9162-02b0aac1cca4 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
63832025-01-11T05:36:24.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a07ba979-ed3d-4271-beff-0524425afeed roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63842025-01-11T05:36:24.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a07ba979-ed3d-4271-beff-0524425afeed resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63852025-01-11T05:36:24.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a07ba979-ed3d-4271-beff-0524425afeed response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63862025-01-11T05:36:25.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5fcffa8-cfb5-4469-ade4-7178a7bcfa2f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63872025-01-11T05:36:25.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5fcffa8-cfb5-4469-ade4-7178a7bcfa2f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63882025-01-11T05:36:25.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f5fcffa8-cfb5-4469-ade4-7178a7bcfa2f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63892025-01-11T05:36:26.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7bcc5f6b-c571-4f29-8e7a-cb7f20319acc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63902025-01-11T05:36:26.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7bcc5f6b-c571-4f29-8e7a-cb7f20319acc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63912025-01-11T05:36:26.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7bcc5f6b-c571-4f29-8e7a-cb7f20319acc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63922025-01-11T05:36:27.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3c910282-17ca-404a-ac20-1798e5b12fc5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63932025-01-11T05:36:27.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3c910282-17ca-404a-ac20-1798e5b12fc5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63942025-01-11T05:36:27.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3c910282-17ca-404a-ac20-1798e5b12fc5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63952025-01-11T05:36:28.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f6d422f7-f2b4-4f72-a841-4e03bc16c9c0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63962025-01-11T05:36:28.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f6d422f7-f2b4-4f72-a841-4e03bc16c9c0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63972025-01-11T05:36:28.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f6d422f7-f2b4-4f72-a841-4e03bc16c9c0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63982025-01-11T05:36:29.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 378dd5bf-2f99-487b-852d-13fb31b8e8d8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
63992025-01-11T05:36:29.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 378dd5bf-2f99-487b-852d-13fb31b8e8d8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64002025-01-11T05:36:29.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 378dd5bf-2f99-487b-852d-13fb31b8e8d8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64012025-01-11T05:36:30.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 815ca0f4-cba8-44b9-9eff-52acbc491aaa roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64022025-01-11T05:36:30.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 815ca0f4-cba8-44b9-9eff-52acbc491aaa resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64032025-01-11T05:36:30.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 815ca0f4-cba8-44b9-9eff-52acbc491aaa response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64042025-01-11T05:36:30.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
64052025-01-11T05:36:30.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
64062025-01-11T05:36:30.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64072025-01-11T05:36:30.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64082025-01-11T05:36:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64092025-01-11T05:36:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64102025-01-11T05:36:30.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64112025-01-11T05:36:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64122025-01-11T05:36:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64132025-01-11T05:36:30.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.442418ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64142025-01-11T05:36:30.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64152025-01-11T05:36:30.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64162025-01-11T05:36:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64172025-01-11T05:36:30.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64182025-01-11T05:36:30.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64192025-01-11T05:36:30.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64202025-01-11T05:36:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
64212025-01-11T05:36:30.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64222025-01-11T05:36:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64232025-01-11T05:36:30.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
64242025-01-11T05:36:30.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.528711ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
64252025-01-11T05:36:31.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ff6bd7e6-8589-4e45-b4d9-588b4baf23ba roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64262025-01-11T05:36:31.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ff6bd7e6-8589-4e45-b4d9-588b4baf23ba resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64272025-01-11T05:36:31.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ff6bd7e6-8589-4e45-b4d9-588b4baf23ba response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64282025-01-11T05:36:32.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 083660e9-5b64-43d2-a22d-f744b169bc14 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64292025-01-11T05:36:32.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 083660e9-5b64-43d2-a22d-f744b169bc14 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64302025-01-11T05:36:32.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 083660e9-5b64-43d2-a22d-f744b169bc14 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64312025-01-11T05:36:33.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = df64ca6a-608a-4538-8903-9be48e8f7654 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64322025-01-11T05:36:33.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = df64ca6a-608a-4538-8903-9be48e8f7654 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64332025-01-11T05:36:33.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = df64ca6a-608a-4538-8903-9be48e8f7654 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64342025-01-11T05:36:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = f7c00b5e-0b66-4350-a22a-b589d0eed0d5 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
64352025-01-11T05:36:34.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 43b04e90-c38a-4241-8106-41ab2cc28530 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64362025-01-11T05:36:34.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 43b04e90-c38a-4241-8106-41ab2cc28530 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64372025-01-11T05:36:34.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 43b04e90-c38a-4241-8106-41ab2cc28530 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64382025-01-11T05:36:35.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2cc7029b-753e-43d6-a816-723ffd3a52f2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64392025-01-11T05:36:35.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2cc7029b-753e-43d6-a816-723ffd3a52f2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64402025-01-11T05:36:35.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2cc7029b-753e-43d6-a816-723ffd3a52f2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64412025-01-11T05:36:36.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4166943c-0bb6-4a93-a727-1e597e6496c2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64422025-01-11T05:36:36.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4166943c-0bb6-4a93-a727-1e597e6496c2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64432025-01-11T05:36:36.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4166943c-0bb6-4a93-a727-1e597e6496c2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64442025-01-11T05:36:37.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bf9efdf1-7b9e-4909-8876-193ddbe191b1 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64452025-01-11T05:36:37.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bf9efdf1-7b9e-4909-8876-193ddbe191b1 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64462025-01-11T05:36:37.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = bf9efdf1-7b9e-4909-8876-193ddbe191b1 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64472025-01-11T05:36:38.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 23f26999-ee14-4e12-8929-bb587abcc561 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64482025-01-11T05:36:38.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 23f26999-ee14-4e12-8929-bb587abcc561 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64492025-01-11T05:36:38.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 23f26999-ee14-4e12-8929-bb587abcc561 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64502025-01-11T05:36:39.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36dab017-55fb-45c8-b115-d038050804d3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64512025-01-11T05:36:39.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36dab017-55fb-45c8-b115-d038050804d3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64522025-01-11T05:36:39.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 36dab017-55fb-45c8-b115-d038050804d3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
64532025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
64542025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64552025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
64562025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64572025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
64582025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64592025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
64602025-01-11T05:36:40.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
64612025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
64622025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.91\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
64632025-01-11T05:36:40.601ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
64642025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
64652025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
64662025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64672025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64682025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
64692025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64702025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
64712025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
64722025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64732025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
64742025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
64752025-01-11T05:36:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64762025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
64772025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64782025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64792025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
64802025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64812025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
64822025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64832025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
64842025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
64852025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64862025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
64872025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
64882025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64892025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
64902025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
64912025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64922025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64932025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
64942025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64952025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
64962025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
64972025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
64982025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64992025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65002025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65012025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
65022025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65032025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65042025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
65052025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
65062025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65072025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
65082025-01-11T05:36:40.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:26:40.602230047 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
65092025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
65102025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
65112025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
65122025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
65132025-01-11T05:36:40.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
65142025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65152025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65162025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65172025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65182025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65192025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65202025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65212025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65222025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65232025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65242025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65252025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65262025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65272025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65282025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65292025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65302025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65312025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65322025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65332025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65342025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65352025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65362025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65372025-01-11T05:36:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1740, tv_nsec: 159092132 } })
65382025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65392025-01-11T05:36:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65402025-01-11T05:36:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1740, tv_nsec: 159103883 } })
65412025-01-11T05:36:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
65422025-01-11T05:36:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.180036ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
65432025-01-11T05:36:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
65442025-01-11T05:36:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.230317ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
65452025-01-11T05:36:40.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1740, tv_nsec: 161652328 } })
65462025-01-11T05:36:40.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65472025-01-11T05:36:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.943997ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65482025-01-11T05:36:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.311794ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
65492025-01-11T05:36:40.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1740, tv_nsec: 163522169 } })
65502025-01-11T05:36:40.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65512025-01-11T05:36:40.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65522025-01-11T05:36:40.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65532025-01-11T05:36:40.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65542025-01-11T05:36:40.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65552025-01-11T05:36:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65562025-01-11T05:36:40.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65572025-01-11T05:36:40.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65582025-01-11T05:36:40.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65592025-01-11T05:36:40.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65602025-01-11T05:36:40.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65612025-01-11T05:36:40.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65622025-01-11T05:36:40.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65632025-01-11T05:36:40.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65642025-01-11T05:36:40.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65652025-01-11T05:36:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65662025-01-11T05:36:40.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65672025-01-11T05:36:40.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65682025-01-11T05:36:40.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65692025-01-11T05:36:40.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702025-01-11T05:36:40.623ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:26:40.602230047 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65712025-01-11T05:36:40.623ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.99512ms iteration = 14 status = {"expiration":"2025-01-11T05:26:40.602230047Z","pruned":[]}
65722025-01-11T05:36:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65732025-01-11T05:36:40.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65742025-01-11T05:36:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65752025-01-11T05:36:40.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65762025-01-11T05:36:40.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65772025-01-11T05:36:40.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65782025-01-11T05:36:40.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65792025-01-11T05:36:40.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 24.016476ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
65802025-01-11T05:36:40.626ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812025-01-11T05:36:40.628ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65822025-01-11T05:36:40.628ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65832025-01-11T05:36:40.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65842025-01-11T05:36:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65852025-01-11T05:36:40.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65862025-01-11T05:36:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65872025-01-11T05:36:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65882025-01-11T05:36:40.629ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65892025-01-11T05:36:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65902025-01-11T05:36:40.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65912025-01-11T05:36:40.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65922025-01-11T05:36:40.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65932025-01-11T05:36:40.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65942025-01-11T05:36:40.632ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1740, tv_nsec: 188812883 } })
65952025-01-11T05:36:40.632ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
65962025-01-11T05:36:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65972025-01-11T05:36:40.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65982025-01-11T05:36:40.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992025-01-11T05:36:40.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66002025-01-11T05:36:40.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66012025-01-11T05:36:40.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66022025-01-11T05:36:40.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66032025-01-11T05:36:40.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66042025-01-11T05:36:40.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66052025-01-11T05:36:40.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66062025-01-11T05:36:40.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66072025-01-11T05:36:40.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66082025-01-11T05:36:40.650ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66092025-01-11T05:36:40.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66102025-01-11T05:36:40.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.552158ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
66112025-01-11T05:36:40.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66122025-01-11T05:36:40.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66132025-01-11T05:36:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66142025-01-11T05:36:40.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66152025-01-11T05:36:40.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66162025-01-11T05:36:40.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66172025-01-11T05:36:40.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.472027ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66182025-01-11T05:36:40.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66192025-01-11T05:36:40.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66202025-01-11T05:36:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66212025-01-11T05:36:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66222025-01-11T05:36:40.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66232025-01-11T05:36:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66242025-01-11T05:36:40.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66252025-01-11T05:36:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66262025-01-11T05:36:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66272025-01-11T05:36:40.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.553285ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66282025-01-11T05:36:40.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66292025-01-11T05:36:40.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66302025-01-11T05:36:40.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66312025-01-11T05:36:40.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66322025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66332025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66342025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66352025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66362025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66372025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.487359ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66382025-01-11T05:36:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66392025-01-11T05:36:40.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402025-01-11T05:36:40.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66412025-01-11T05:36:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66422025-01-11T05:36:40.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66432025-01-11T05:36:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66442025-01-11T05:36:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
66452025-01-11T05:36:40.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66462025-01-11T05:36:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66472025-01-11T05:36:40.679ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
66482025-01-11T05:36:40.679ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
66492025-01-11T05:36:40.679ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
66502025-01-11T05:36:40.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66512025-01-11T05:36:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66522025-01-11T05:36:40.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66532025-01-11T05:36:40.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66542025-01-11T05:36:40.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66552025-01-11T05:36:40.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66562025-01-11T05:36:40.686ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66572025-01-11T05:36:40.686ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
66582025-01-11T05:36:40.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66592025-01-11T05:36:40.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66602025-01-11T05:36:40.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66612025-01-11T05:36:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66622025-01-11T05:36:40.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66632025-01-11T05:36:40.689ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
66642025-01-11T05:36:40.689ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.347712ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
66652025-01-11T05:36:40.689ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66662025-01-11T05:36:40.689ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66672025-01-11T05:36:40.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66682025-01-11T05:36:40.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66692025-01-11T05:36:40.690ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66702025-01-11T05:36:40.690ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66712025-01-11T05:36:40.690ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.572079ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66722025-01-11T05:36:40.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66732025-01-11T05:36:40.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66742025-01-11T05:36:40.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66752025-01-11T05:36:40.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66762025-01-11T05:36:40.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66772025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.301438ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66782025-01-11T05:36:40.693ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66792025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.169546ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66802025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66812025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
66822025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66832025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
66842025-01-11T05:36:40.693ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 91.735538ms iteration = 14 status = {"generation":2}
66852025-01-11T05:36:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66862025-01-11T05:36:40.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66872025-01-11T05:36:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66882025-01-11T05:36:40.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66892025-01-11T05:36:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
66902025-01-11T05:36:40.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66912025-01-11T05:36:40.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66922025-01-11T05:36:40.703ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.780618ms iteration = 27 status = 0
66932025-01-11T05:36:40.704ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66942025-01-11T05:36:40.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66952025-01-11T05:36:40.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66962025-01-11T05:36:40.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66972025-01-11T05:36:40.707ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66982025-01-11T05:36:40.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66992025-01-11T05:36:40.716ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67002025-01-11T05:36:40.716ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67012025-01-11T05:36:40.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67022025-01-11T05:36:40.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67032025-01-11T05:36:40.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042025-01-11T05:36:40.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67052025-01-11T05:36:40.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67062025-01-11T05:36:40.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67072025-01-11T05:36:40.723ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67082025-01-11T05:36:40.723ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67092025-01-11T05:36:40.723ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
67102025-01-11T05:36:40.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 121.5079ms iteration = 14 status = {"generation":1}
67112025-01-11T05:36:40.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 29c2a90c-0048-4395-86a7-5bb843eea727 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
67122025-01-11T05:36:40.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 29c2a90c-0048-4395-86a7-5bb843eea727 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
67132025-01-11T05:36:40.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 29c2a90c-0048-4395-86a7-5bb843eea727 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
67142025-01-11T05:36:40.733ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67152025-01-11T05:36:40.733ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67162025-01-11T05:36:40.733ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 131.14053ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67172025-01-11T05:36:40.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.165813ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67182025-01-11T05:36:40.736ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67192025-01-11T05:36:40.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67202025-01-11T05:36:40.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67212025-01-11T05:36:40.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67222025-01-11T05:36:40.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67232025-01-11T05:36:40.750ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
67242025-01-11T05:36:40.750ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 148.707206ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67252025-01-11T05:36:40.778ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.873702ms iteration = 30 status = {"physical_disks_added":0}
67262025-01-11T05:36:40.782ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67272025-01-11T05:36:40.782ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 180.356988ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67282025-01-11T05:36:40.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67292025-01-11T05:36:40.787ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67302025-01-11T05:36:40.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67312025-01-11T05:36:40.787ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67322025-01-11T05:36:40.787ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7c062b2-599e-431e-adf7-aed206ccc066", "content-length": "26", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67332025-01-11T05:36:40.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67342025-01-11T05:36:40.787ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e338e880-dacc-4a91-8c45-0eb7ef8cd254", "content-length": "26", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67352025-01-11T05:36:40.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67362025-01-11T05:36:40.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67372025-01-11T05:36:40.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67382025-01-11T05:36:40.842ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67392025-01-11T05:36:40.892ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67402025-01-11T05:36:40.915ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67412025-01-11T05:36:40.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67422025-01-11T05:36:40.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb11f166-dfb9-4b73-b9fe-5d6cfc5777fa", "content-length": "372", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67432025-01-11T05:36:40.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67442025-01-11T05:36:40.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67452025-01-11T05:36:40.929ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67462025-01-11T05:36:40.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67472025-01-11T05:36:40.929ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "00498997-33e6-47c7-98b4-c56c22743409", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67482025-01-11T05:36:40.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67492025-01-11T05:36:40.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67502025-01-11T05:36:40.932ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67512025-01-11T05:36:40.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67522025-01-11T05:36:40.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67532025-01-11T05:36:40.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67542025-01-11T05:36:40.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
67552025-01-11T05:36:40.937ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67562025-01-11T05:36:40.937ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "202314d0-1886-41ea-9b7a-87b0b62a5ea0", "content-length": "26", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67572025-01-11T05:36:40.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67582025-01-11T05:36:40.938ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67592025-01-11T05:36:40.938ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67602025-01-11T05:36:40.938ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d885955-5bba-429f-a29c-f2523271d344", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67612025-01-11T05:36:40.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
67622025-01-11T05:36:40.939ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.774545ms iteration = 28 status = {}
67632025-01-11T05:36:40.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67642025-01-11T05:36:40.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67652025-01-11T05:36:40.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67662025-01-11T05:36:40.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67672025-01-11T05:36:40.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682025-01-11T05:36:40.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67692025-01-11T05:36:40.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67702025-01-11T05:36:40.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67712025-01-11T05:36:40.969ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67722025-01-11T05:36:40.969ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f20ee2fe-6c69-489a-81fa-61fe95986884", "content-length": "2", "date": "Sat, 11 Jan 2025 05:36:39 GMT"} })
67732025-01-11T05:36:40.969ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 367.860913ms iteration = 27 status = {}
67742025-01-11T05:36:40.970ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67752025-01-11T05:36:40.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67762025-01-11T05:36:40.972ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 371.016382ms iteration = 27 status = null
67772025-01-11T05:36:41.024ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67782025-01-11T05:36:41.025ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f66fecc2-d587-4659-9edd-35c84b528993", "date": "Sat, 11 Jan 2025 05:36:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67792025-01-11T05:36:41.025ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67802025-01-11T05:36:41.027ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "29b7648d-c25a-419c-a0a9-c79f0a5509d9", "date": "Sat, 11 Jan 2025 05:36:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67812025-01-11T05:36:41.027ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67822025-01-11T05:36:41.029ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d009e858-a6d2-4103-8963-e607fb153a7e", "date": "Sat, 11 Jan 2025 05:36:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67832025-01-11T05:36:41.029ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67842025-01-11T05:36:41.031ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67852025-01-11T05:36:41.031ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 429.042472ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
67862025-01-11T05:36:41.082ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67872025-01-11T05:36:41.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e1be2088-76b4-4605-87bd-02a3bf9b2da3", "date": "Sat, 11 Jan 2025 05:36:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67882025-01-11T05:36:41.082ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67892025-01-11T05:36:41.084ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b48bf59b-aa30-4816-97b7-bd46f8ecd864", "date": "Sat, 11 Jan 2025 05:36:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67902025-01-11T05:36:41.084ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67912025-01-11T05:36:41.086ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
67922025-01-11T05:36:41.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 484.451135ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67932025-01-11T05:36:41.110ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67942025-01-11T05:36:41.110ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e0b85f8-84e0-492a-af09-c639c464c860", "content-length": "691", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
67952025-01-11T05:36:41.110ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67962025-01-11T05:36:41.110ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67972025-01-11T05:36:41.110ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67982025-01-11T05:36:41.111ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 509.230477ms iteration = 28 status = {}
67992025-01-11T05:36:41.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68002025-01-11T05:36:41.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68012025-01-11T05:36:41.149ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
68022025-01-11T05:36:41.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68032025-01-11T05:36:41.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68042025-01-11T05:36:41.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68052025-01-11T05:36:41.158ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e1f4641-7ea3-4a4b-bcd2-63b23df3f80d", "content-length": "134", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
68062025-01-11T05:36:41.158ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68072025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
68082025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68092025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68102025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68112025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68122025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68132025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68142025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68152025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68162025-01-11T05:36:41.159ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
68172025-01-11T05:36:41.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68182025-01-11T05:36:41.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68192025-01-11T05:36:41.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68202025-01-11T05:36:41.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffa23e1a-f87a-458b-81a4-56d2469bf282", "content-length": "2", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
68212025-01-11T05:36:41.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68222025-01-11T05:36:41.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddd55432-12d2-45af-b8e5-d953f58c4ce6", "content-length": "52", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
68232025-01-11T05:36:41.162ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
68242025-01-11T05:36:41.162ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68252025-01-11T05:36:41.251ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "39b8b2e4-237a-4bdc-b642-cb0d39b8496a", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
68262025-01-11T05:36:41.251ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
68272025-01-11T05:36:41.251ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68282025-01-11T05:36:41.251ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "32776c13-b400-4a27-afce-0aa7563dbf06", "content-length": "682", "date": "Sat, 11 Jan 2025 05:36:40 GMT"} })
68292025-01-11T05:36:41.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68302025-01-11T05:36:41.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68312025-01-11T05:36:41.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68322025-01-11T05:36:41.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68332025-01-11T05:36:41.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68342025-01-11T05:36:41.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68352025-01-11T05:36:41.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68362025-01-11T05:36:41.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68372025-01-11T05:36:41.269ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 667.043431ms iteration = 27 status = {}
68382025-01-11T05:36:41.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aff627ab-a4db-4567-a1d1-edb5b103be57 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68392025-01-11T05:36:41.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aff627ab-a4db-4567-a1d1-edb5b103be57 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68402025-01-11T05:36:41.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = aff627ab-a4db-4567-a1d1-edb5b103be57 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68412025-01-11T05:36:42.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c26ae092-d773-4b22-ae1b-28c4e2e9fca0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68422025-01-11T05:36:42.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c26ae092-d773-4b22-ae1b-28c4e2e9fca0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68432025-01-11T05:36:42.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c26ae092-d773-4b22-ae1b-28c4e2e9fca0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68442025-01-11T05:36:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = f5ebfc25-a7cb-4a3a-be38-b29f00358c4c response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
68452025-01-11T05:36:43.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 56d2de92-ef6d-44b2-a25d-bf21d616ab23 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68462025-01-11T05:36:43.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 56d2de92-ef6d-44b2-a25d-bf21d616ab23 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68472025-01-11T05:36:43.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 56d2de92-ef6d-44b2-a25d-bf21d616ab23 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68482025-01-11T05:36:44.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8eb9d39-4c41-4215-bcf3-54a7dc9aa2b2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68492025-01-11T05:36:44.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8eb9d39-4c41-4215-bcf3-54a7dc9aa2b2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68502025-01-11T05:36:44.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8eb9d39-4c41-4215-bcf3-54a7dc9aa2b2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68512025-01-11T05:36:45.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = fad0641a-cfd3-4799-a22e-698b0a230ecb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
68522025-01-11T05:36:45.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = fad0641a-cfd3-4799-a22e-698b0a230ecb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
68532025-01-11T05:36:45.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = fad0641a-cfd3-4799-a22e-698b0a230ecb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
68542025-01-11T05:36:45.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ce7c8e0e-cfab-4510-ba2b-0f33893bb085 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68552025-01-11T05:36:45.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ce7c8e0e-cfab-4510-ba2b-0f33893bb085 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68562025-01-11T05:36:45.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ce7c8e0e-cfab-4510-ba2b-0f33893bb085 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68572025-01-11T05:36:46.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 46ee366d-df3f-46df-a10c-b893e3f8b9fd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68582025-01-11T05:36:46.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 46ee366d-df3f-46df-a10c-b893e3f8b9fd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68592025-01-11T05:36:46.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 46ee366d-df3f-46df-a10c-b893e3f8b9fd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68602025-01-11T05:36:47.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b8cdaad0-6f0d-4883-9026-3d5ba821c1f0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68612025-01-11T05:36:47.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b8cdaad0-6f0d-4883-9026-3d5ba821c1f0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68622025-01-11T05:36:47.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b8cdaad0-6f0d-4883-9026-3d5ba821c1f0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68632025-01-11T05:36:48.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4fc86f04-7b9f-4e40-a5a3-ff797e66c621 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68642025-01-11T05:36:48.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4fc86f04-7b9f-4e40-a5a3-ff797e66c621 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68652025-01-11T05:36:48.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4fc86f04-7b9f-4e40-a5a3-ff797e66c621 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68662025-01-11T05:36:49.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a1f2a55e-4151-44aa-a6ba-d00e278ceeb0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68672025-01-11T05:36:49.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a1f2a55e-4151-44aa-a6ba-d00e278ceeb0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68682025-01-11T05:36:49.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a1f2a55e-4151-44aa-a6ba-d00e278ceeb0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68692025-01-11T05:36:50.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
68702025-01-11T05:36:50.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68712025-01-11T05:36:50.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
68722025-01-11T05:36:50.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68732025-01-11T05:36:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68742025-01-11T05:36:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68752025-01-11T05:36:50.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68762025-01-11T05:36:50.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68772025-01-11T05:36:50.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68782025-01-11T05:36:50.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.459506ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68792025-01-11T05:36:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68802025-01-11T05:36:50.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68812025-01-11T05:36:50.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68822025-01-11T05:36:50.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68832025-01-11T05:36:50.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68842025-01-11T05:36:50.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68852025-01-11T05:36:50.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
68862025-01-11T05:36:50.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68872025-01-11T05:36:50.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68882025-01-11T05:36:50.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
68892025-01-11T05:36:50.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.357025ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
68902025-01-11T05:36:50.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 942155d9-6f86-4efd-a3d9-af0ff5af0f84 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68912025-01-11T05:36:50.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 942155d9-6f86-4efd-a3d9-af0ff5af0f84 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68922025-01-11T05:36:50.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 942155d9-6f86-4efd-a3d9-af0ff5af0f84 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68932025-01-11T05:36:51.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdbfeee4-dc2c-4193-87c4-521a7ef2028b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68942025-01-11T05:36:51.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdbfeee4-dc2c-4193-87c4-521a7ef2028b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68952025-01-11T05:36:51.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdbfeee4-dc2c-4193-87c4-521a7ef2028b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68962025-01-11T05:36:52.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7a36fea9-09e6-428b-9216-23de0740312f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68972025-01-11T05:36:52.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7a36fea9-09e6-428b-9216-23de0740312f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68982025-01-11T05:36:53.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7a36fea9-09e6-428b-9216-23de0740312f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
68992025-01-11T05:36:53.782ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 664 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = eab0c068-04ca-4548-ab7a-e2b767bb59c1 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
69002025-01-11T05:36:54.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fe4db3be-7998-4ddf-872d-d78f20831093 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69012025-01-11T05:36:54.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fe4db3be-7998-4ddf-872d-d78f20831093 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69022025-01-11T05:36:54.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fe4db3be-7998-4ddf-872d-d78f20831093 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69032025-01-11T05:36:55.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee897c7d-ba6a-44e5-952e-595b6e8a7831 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69042025-01-11T05:36:55.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee897c7d-ba6a-44e5-952e-595b6e8a7831 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69052025-01-11T05:36:55.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee897c7d-ba6a-44e5-952e-595b6e8a7831 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69062025-01-11T05:36:56.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5414e69f-000e-4b87-8fff-0a88246536af roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69072025-01-11T05:36:56.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5414e69f-000e-4b87-8fff-0a88246536af resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69082025-01-11T05:36:56.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5414e69f-000e-4b87-8fff-0a88246536af response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69092025-01-11T05:36:57.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3976aac-80bd-4a67-9faa-438e5b14cd87 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69102025-01-11T05:36:57.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3976aac-80bd-4a67-9faa-438e5b14cd87 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69112025-01-11T05:36:57.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3976aac-80bd-4a67-9faa-438e5b14cd87 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69122025-01-11T05:36:58.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dc689c5f-17d8-48e7-986a-ad828860d8c0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69132025-01-11T05:36:58.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dc689c5f-17d8-48e7-986a-ad828860d8c0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69142025-01-11T05:36:58.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = dc689c5f-17d8-48e7-986a-ad828860d8c0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69152025-01-11T05:36:59.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4780e757-ca5f-4092-a503-65bd245fe626 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69162025-01-11T05:36:59.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4780e757-ca5f-4092-a503-65bd245fe626 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69172025-01-11T05:36:59.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4780e757-ca5f-4092-a503-65bd245fe626 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69182025-01-11T05:37:00.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7eb45a10-c9db-48e9-a85c-137911e5580b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69192025-01-11T05:37:00.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7eb45a10-c9db-48e9-a85c-137911e5580b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69202025-01-11T05:37:00.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7eb45a10-c9db-48e9-a85c-137911e5580b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69212025-01-11T05:37:00.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
69222025-01-11T05:37:00.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
69232025-01-11T05:37:00.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69242025-01-11T05:37:00.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69252025-01-11T05:37:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69262025-01-11T05:37:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69272025-01-11T05:37:00.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69282025-01-11T05:37:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69292025-01-11T05:37:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69302025-01-11T05:37:00.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.621061ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69312025-01-11T05:37:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69322025-01-11T05:37:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69332025-01-11T05:37:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69342025-01-11T05:37:00.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69352025-01-11T05:37:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69362025-01-11T05:37:00.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69372025-01-11T05:37:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
69382025-01-11T05:37:00.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69392025-01-11T05:37:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69402025-01-11T05:37:00.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
69412025-01-11T05:37:00.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.389906ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
69422025-01-11T05:37:01.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1766d7d0-1dc3-42b5-800f-d1fb62318c53 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69432025-01-11T05:37:01.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1766d7d0-1dc3-42b5-800f-d1fb62318c53 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69442025-01-11T05:37:01.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1766d7d0-1dc3-42b5-800f-d1fb62318c53 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69452025-01-11T05:37:02.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a7405e80-99b0-4c3b-bd8b-ed4d94049c3e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69462025-01-11T05:37:02.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a7405e80-99b0-4c3b-bd8b-ed4d94049c3e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69472025-01-11T05:37:02.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a7405e80-99b0-4c3b-bd8b-ed4d94049c3e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69482025-01-11T05:37:03.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0987180e-28ae-4d9f-82c7-ecf77e3e59fa roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69492025-01-11T05:37:03.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0987180e-28ae-4d9f-82c7-ecf77e3e59fa resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69502025-01-11T05:37:03.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0987180e-28ae-4d9f-82c7-ecf77e3e59fa response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69512025-01-11T05:37:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 663 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = e8d621cd-437e-4707-af69-f05761b85492 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
69522025-01-11T05:37:04.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 47b3ffd3-79f6-49ce-b77f-c991f47063d6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69532025-01-11T05:37:04.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 47b3ffd3-79f6-49ce-b77f-c991f47063d6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69542025-01-11T05:37:04.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 47b3ffd3-79f6-49ce-b77f-c991f47063d6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69552025-01-11T05:37:05.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 38e2d523-0fdb-49ff-9f5e-30289cfb49b8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69562025-01-11T05:37:05.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 38e2d523-0fdb-49ff-9f5e-30289cfb49b8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69572025-01-11T05:37:05.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 38e2d523-0fdb-49ff-9f5e-30289cfb49b8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69582025-01-11T05:37:06.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 21c85a1e-cf7e-4237-a4a6-ac81342041cd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69592025-01-11T05:37:06.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 21c85a1e-cf7e-4237-a4a6-ac81342041cd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69602025-01-11T05:37:06.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 21c85a1e-cf7e-4237-a4a6-ac81342041cd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69612025-01-11T05:37:07.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73561c46-996d-4e67-b6af-d723574a26e2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69622025-01-11T05:37:07.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73561c46-996d-4e67-b6af-d723574a26e2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69632025-01-11T05:37:07.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73561c46-996d-4e67-b6af-d723574a26e2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69642025-01-11T05:37:08.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9f415d54-a69a-4f82-bade-a9587df65c95 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69652025-01-11T05:37:08.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9f415d54-a69a-4f82-bade-a9587df65c95 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69662025-01-11T05:37:08.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9f415d54-a69a-4f82-bade-a9587df65c95 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69672025-01-11T05:37:09.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 25e708e5-104e-494c-84c4-524a8579a675 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69682025-01-11T05:37:09.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 25e708e5-104e-494c-84c4-524a8579a675 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69692025-01-11T05:37:09.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 25e708e5-104e-494c-84c4-524a8579a675 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69702025-01-11T05:37:10.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8ff1d264-bf24-4392-8358-633707c0a249 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69712025-01-11T05:37:10.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8ff1d264-bf24-4392-8358-633707c0a249 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69722025-01-11T05:37:10.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8ff1d264-bf24-4392-8358-633707c0a249 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
69732025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
69742025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
69752025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69762025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69772025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
69782025-01-11T05:37:10.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69792025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69802025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
69812025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
69822025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69832025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
69842025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
69852025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
69862025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69872025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69882025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69892025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
69902025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69912025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
69922025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69932025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
69942025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69952025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
69962025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69972025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
69982025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69992025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
70002025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70012025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70022025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
70032025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70042025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
70052025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70062025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70072025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70082025-01-11T05:37:10.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70092025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70102025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70112025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70122025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70132025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70142025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70152025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70162025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70172025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70182025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70192025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70202025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70212025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
70222025-01-11T05:37:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70232025-01-11T05:37:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70242025-01-11T05:37:10.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70252025-01-11T05:37:10.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70262025-01-11T05:37:10.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.589298ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70272025-01-11T05:37:10.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70282025-01-11T05:37:10.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292025-01-11T05:37:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70302025-01-11T05:37:10.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70312025-01-11T05:37:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70322025-01-11T05:37:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70332025-01-11T05:37:10.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70342025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70352025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70362025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70372025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70382025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70392025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70402025-01-11T05:37:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70412025-01-11T05:37:10.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1770, tv_nsec: 166633003 } })
70422025-01-11T05:37:10.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
70432025-01-11T05:37:10.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442025-01-11T05:37:10.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70452025-01-11T05:37:10.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1770, tv_nsec: 168100326 } })
70462025-01-11T05:37:10.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
70472025-01-11T05:37:10.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70482025-01-11T05:37:10.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70492025-01-11T05:37:10.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70502025-01-11T05:37:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70512025-01-11T05:37:10.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70522025-01-11T05:37:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70532025-01-11T05:37:10.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.567471ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
70542025-01-11T05:37:10.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70552025-01-11T05:37:10.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70562025-01-11T05:37:10.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70572025-01-11T05:37:10.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70582025-01-11T05:37:10.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70592025-01-11T05:37:10.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70602025-01-11T05:37:10.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1770, tv_nsec: 178831420 } })
70612025-01-11T05:37:10.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
70622025-01-11T05:37:10.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70632025-01-11T05:37:10.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70642025-01-11T05:37:10.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70652025-01-11T05:37:10.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70662025-01-11T05:37:10.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-01-11T05:37:10.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70682025-01-11T05:37:10.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70692025-01-11T05:37:10.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70702025-01-11T05:37:10.649ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70712025-01-11T05:37:10.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70722025-01-11T05:37:10.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.177852ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
70732025-01-11T05:37:10.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70742025-01-11T05:37:10.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70752025-01-11T05:37:10.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70762025-01-11T05:37:10.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70772025-01-11T05:37:10.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.629424ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70782025-01-11T05:37:10.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70792025-01-11T05:37:10.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70802025-01-11T05:37:10.666ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70812025-01-11T05:37:10.666ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70822025-01-11T05:37:10.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70832025-01-11T05:37:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70842025-01-11T05:37:10.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70852025-01-11T05:37:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70862025-01-11T05:37:10.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70872025-01-11T05:37:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70882025-01-11T05:37:10.668ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70892025-01-11T05:37:10.668ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70902025-01-11T05:37:10.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70912025-01-11T05:37:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70922025-01-11T05:37:10.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70932025-01-11T05:37:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70942025-01-11T05:37:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70952025-01-11T05:37:10.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70962025-01-11T05:37:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70972025-01-11T05:37:10.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70982025-01-11T05:37:10.673ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70992025-01-11T05:37:10.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.376864ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71002025-01-11T05:37:10.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71012025-01-11T05:37:10.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71022025-01-11T05:37:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71032025-01-11T05:37:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
71042025-01-11T05:37:10.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71052025-01-11T05:37:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71062025-01-11T05:37:10.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71072025-01-11T05:37:10.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
71082025-01-11T05:37:10.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71092025-01-11T05:37:10.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71102025-01-11T05:37:10.681ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.996761ms iteration = 28 status = 0
71112025-01-11T05:37:10.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.532245ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71122025-01-11T05:37:10.689ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
71132025-01-11T05:37:10.689ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.196901ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
71142025-01-11T05:37:10.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.98111ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71152025-01-11T05:37:10.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71162025-01-11T05:37:10.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71172025-01-11T05:37:10.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71182025-01-11T05:37:10.698ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71192025-01-11T05:37:10.698ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ccad21-f621-4c15-bbdf-6812d2e5fa5e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71202025-01-11T05:37:10.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71212025-01-11T05:37:10.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71222025-01-11T05:37:10.706ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71232025-01-11T05:37:10.706ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71242025-01-11T05:37:10.706ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.937207ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71252025-01-11T05:37:10.712ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71262025-01-11T05:37:10.712ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71272025-01-11T05:37:10.712ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2808c86-6bf5-4184-9380-fb5e150a016e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71282025-01-11T05:37:10.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71292025-01-11T05:37:10.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71302025-01-11T05:37:10.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71312025-01-11T05:37:10.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71322025-01-11T05:37:10.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71332025-01-11T05:37:10.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71342025-01-11T05:37:10.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.422783ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71352025-01-11T05:37:10.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
71362025-01-11T05:37:10.737ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71372025-01-11T05:37:10.738ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96267da5-83ec-48f8-aac2-5bc1d4781a7e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71382025-01-11T05:37:10.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71392025-01-11T05:37:10.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
71402025-01-11T05:37:10.741ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.545955ms iteration = 31 status = {"physical_disks_added":0}
71412025-01-11T05:37:10.827ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 225.554938ms iteration = 28 status = {}
71422025-01-11T05:37:10.832ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71432025-01-11T05:37:10.832ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71442025-01-11T05:37:10.833ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "84dffb43-d4e4-4470-9548-d010f3946e74", "content-length": "372", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71452025-01-11T05:37:10.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71462025-01-11T05:37:10.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71472025-01-11T05:37:10.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71482025-01-11T05:37:10.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "08c364b5-9631-46f4-9394-a4645525186b", "content-length": "691", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71492025-01-11T05:37:10.843ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71502025-01-11T05:37:10.843ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71512025-01-11T05:37:10.843ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71522025-01-11T05:37:10.844ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 243.232144ms iteration = 29 status = {}
71532025-01-11T05:37:10.847ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71542025-01-11T05:37:10.847ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b343a72-375f-42f2-8f3b-793c728ca8d4", "content-length": "2", "date": "Sat, 11 Jan 2025 05:37:09 GMT"} })
71552025-01-11T05:37:10.848ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71562025-01-11T05:37:10.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71572025-01-11T05:37:10.851ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 249.442781ms iteration = 28 status = null
71582025-01-11T05:37:10.872ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
71592025-01-11T05:37:10.872ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71602025-01-11T05:37:10.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7eccbd51-6da6-4301-9640-9228733c1f47", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71612025-01-11T05:37:10.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71622025-01-11T05:37:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71632025-01-11T05:37:10.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71642025-01-11T05:37:10.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71652025-01-11T05:37:10.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71662025-01-11T05:37:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71672025-01-11T05:37:10.882ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71682025-01-11T05:37:10.882ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71692025-01-11T05:37:10.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cda736bf-d135-4352-85f4-006d7e256f4c", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71702025-01-11T05:37:10.884ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 282.945404ms iteration = 29 status = {}
71712025-01-11T05:37:10.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71722025-01-11T05:37:10.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71732025-01-11T05:37:10.913ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
71742025-01-11T05:37:10.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71752025-01-11T05:37:10.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71762025-01-11T05:37:10.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71772025-01-11T05:37:10.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce99a4fa-b7e7-46fe-9491-f0505d7b37da", "content-length": "134", "date": "Sat, 11 Jan 2025 05:37:09 GMT"} })
71782025-01-11T05:37:10.922ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71792025-01-11T05:37:10.922ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
71802025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71812025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71822025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71832025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71842025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71852025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71862025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71872025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71882025-01-11T05:37:10.923ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
71892025-01-11T05:37:10.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71902025-01-11T05:37:10.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71912025-01-11T05:37:10.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71922025-01-11T05:37:10.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "55287cbb-845e-4649-b4a9-eb1175702c60", "content-length": "2", "date": "Sat, 11 Jan 2025 05:37:09 GMT"} })
71932025-01-11T05:37:10.925ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71942025-01-11T05:37:10.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "30fe8604-891a-4c2e-80d4-1ea8a4b80660", "content-length": "52", "date": "Sat, 11 Jan 2025 05:37:09 GMT"} })
71952025-01-11T05:37:10.925ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
71962025-01-11T05:37:10.925ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71972025-01-11T05:37:11.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9dae2d3f-f7d6-44a9-86bf-776b36af2c76", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
71982025-01-11T05:37:11.024ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
71992025-01-11T05:37:11.025ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72002025-01-11T05:37:11.025ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65a01a0-b3cc-4728-acba-136a7d9221e4", "content-length": "682", "date": "Sat, 11 Jan 2025 05:37:10 GMT"} })
72012025-01-11T05:37:11.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72022025-01-11T05:37:11.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72032025-01-11T05:37:11.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72042025-01-11T05:37:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72052025-01-11T05:37:11.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72062025-01-11T05:37:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72072025-01-11T05:37:11.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72082025-01-11T05:37:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72092025-01-11T05:37:11.043ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 441.510665ms iteration = 28 status = {}
72102025-01-11T05:37:11.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 190ae397-29c6-4ecc-9d91-9112c93d8574 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72112025-01-11T05:37:11.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 190ae397-29c6-4ecc-9d91-9112c93d8574 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72122025-01-11T05:37:11.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 190ae397-29c6-4ecc-9d91-9112c93d8574 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72132025-01-11T05:37:11.655ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
72142025-01-11T05:37:11.655ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
72152025-01-11T05:37:11.690ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
72162025-01-11T05:37:11.690ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45920
72172025-01-11T05:37:11.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45920 req_id = b2a1cf0b-a478-4a55-9000-b1c6551e6970 roles = RoleSet { roles: {} } uri = /metrics/producers
72182025-01-11T05:37:11.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45920 req_id = b2a1cf0b-a478-4a55-9000-b1c6551e6970 resource = Database result = Ok(()) uri = /metrics/producers
72192025-01-11T05:37:11.743ZINFOnexus: assigned collector to new producer collector_id = 68ba0762-4eeb-4568-8923-69d504e34a00 file = nexus/src/app/oximeter.rs:76 producer_id = aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
72202025-01-11T05:37:11.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52135 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45920 req_id = b2a1cf0b-a478-4a55-9000-b1c6551e6970 response_code = 201 uri = /metrics/producers
72212025-01-11T05:37:11.743ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b2a1cf0b-a478-4a55-9000-b1c6551e6970", "content-length": "41", "date": "Sat, 11 Jan 2025 05:37:11 GMT"} })
72222025-01-11T05:37:11.744ZDEBGnexus (producer-registration-task): registered with nexus successfully
72232025-01-11T05:37:11.744ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72242025-01-11T05:37:12.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 47afd053-4ce7-43c2-8056-8356b6c7b9f7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72252025-01-11T05:37:12.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 47afd053-4ce7-43c2-8056-8356b6c7b9f7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72262025-01-11T05:37:12.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 47afd053-4ce7-43c2-8056-8356b6c7b9f7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72272025-01-11T05:37:13.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 33ba00f4-42e8-4e32-b67a-9d3199a027a9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72282025-01-11T05:37:13.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 33ba00f4-42e8-4e32-b67a-9d3199a027a9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72292025-01-11T05:37:13.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 33ba00f4-42e8-4e32-b67a-9d3199a027a9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72302025-01-11T05:37:13.782ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 635 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 0a0a83dd-0ea2-4561-90c3-8fbf285396c6 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
72312025-01-11T05:37:14.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de33cb6a-7d4c-4d3e-bb6b-a252db98a4e6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72322025-01-11T05:37:14.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de33cb6a-7d4c-4d3e-bb6b-a252db98a4e6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72332025-01-11T05:37:14.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de33cb6a-7d4c-4d3e-bb6b-a252db98a4e6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72342025-01-11T05:37:15.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 6184f4f1-9bab-4cf5-9c54-9a36a9e9add0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
72352025-01-11T05:37:15.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 6184f4f1-9bab-4cf5-9c54-9a36a9e9add0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
72362025-01-11T05:37:15.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = 6184f4f1-9bab-4cf5-9c54-9a36a9e9add0 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
72372025-01-11T05:37:15.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19488c56-da8b-494c-a61d-c7a6664c53ae roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72382025-01-11T05:37:15.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19488c56-da8b-494c-a61d-c7a6664c53ae resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72392025-01-11T05:37:15.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 19488c56-da8b-494c-a61d-c7a6664c53ae response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72402025-01-11T05:37:16.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f768ac05-1e74-4c7b-9576-1d1c31288af6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72412025-01-11T05:37:16.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f768ac05-1e74-4c7b-9576-1d1c31288af6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72422025-01-11T05:37:16.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f768ac05-1e74-4c7b-9576-1d1c31288af6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72432025-01-11T05:37:17.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a159a4d6-2551-4f92-9133-2862ee815bb8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72442025-01-11T05:37:17.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a159a4d6-2551-4f92-9133-2862ee815bb8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72452025-01-11T05:37:17.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a159a4d6-2551-4f92-9133-2862ee815bb8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72462025-01-11T05:37:18.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4da0da59-03e3-4c4a-80ed-de01a0680897 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72472025-01-11T05:37:18.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4da0da59-03e3-4c4a-80ed-de01a0680897 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72482025-01-11T05:37:18.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4da0da59-03e3-4c4a-80ed-de01a0680897 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72492025-01-11T05:37:19.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3083c5e2-9a08-4fdd-a2da-1e7c78375846 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72502025-01-11T05:37:19.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3083c5e2-9a08-4fdd-a2da-1e7c78375846 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72512025-01-11T05:37:19.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3083c5e2-9a08-4fdd-a2da-1e7c78375846 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72522025-01-11T05:37:20.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e3fc1017-b631-413c-8e9e-45208da9fff5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72532025-01-11T05:37:20.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e3fc1017-b631-413c-8e9e-45208da9fff5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72542025-01-11T05:37:20.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e3fc1017-b631-413c-8e9e-45208da9fff5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72552025-01-11T05:37:20.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
72562025-01-11T05:37:20.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
72572025-01-11T05:37:20.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72582025-01-11T05:37:20.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72592025-01-11T05:37:20.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72602025-01-11T05:37:20.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72612025-01-11T05:37:20.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72622025-01-11T05:37:20.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72632025-01-11T05:37:20.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72642025-01-11T05:37:20.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.300084ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72652025-01-11T05:37:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72662025-01-11T05:37:20.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72672025-01-11T05:37:20.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72682025-01-11T05:37:20.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72692025-01-11T05:37:20.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72702025-01-11T05:37:20.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72712025-01-11T05:37:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
72722025-01-11T05:37:20.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72732025-01-11T05:37:20.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72742025-01-11T05:37:20.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
72752025-01-11T05:37:20.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.828522ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
72762025-01-11T05:37:21.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9ace7ff8-b862-45c1-ba01-4ab6f7d6d7e3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72772025-01-11T05:37:21.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9ace7ff8-b862-45c1-ba01-4ab6f7d6d7e3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72782025-01-11T05:37:21.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9ace7ff8-b862-45c1-ba01-4ab6f7d6d7e3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72792025-01-11T05:37:22.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 89544e57-aea8-46d8-8671-682aba05643e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72802025-01-11T05:37:22.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 89544e57-aea8-46d8-8671-682aba05643e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72812025-01-11T05:37:22.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 89544e57-aea8-46d8-8671-682aba05643e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72822025-01-11T05:37:23.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8290ef8-6e9c-43e2-a324-28582167abb8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72832025-01-11T05:37:23.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8290ef8-6e9c-43e2-a324-28582167abb8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72842025-01-11T05:37:23.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c8290ef8-6e9c-43e2-a324-28582167abb8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72852025-01-11T05:37:23.782ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = c4881bd5-5690-4dbd-9b91-a5a01ff9f0d6 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
72862025-01-11T05:37:24.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de5bcbd7-9b72-41b9-8a00-9b203bd9f8dc roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72872025-01-11T05:37:24.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de5bcbd7-9b72-41b9-8a00-9b203bd9f8dc resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72882025-01-11T05:37:24.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = de5bcbd7-9b72-41b9-8a00-9b203bd9f8dc response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72892025-01-11T05:37:25.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e2e9c982-a62b-4ad1-aff9-39a23ae8aebb roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72902025-01-11T05:37:25.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e2e9c982-a62b-4ad1-aff9-39a23ae8aebb resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72912025-01-11T05:37:25.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e2e9c982-a62b-4ad1-aff9-39a23ae8aebb response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72922025-01-11T05:37:26.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 53ac3ef8-5363-4934-aca8-d4c1cd1cddf8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72932025-01-11T05:37:26.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 53ac3ef8-5363-4934-aca8-d4c1cd1cddf8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72942025-01-11T05:37:26.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 53ac3ef8-5363-4934-aca8-d4c1cd1cddf8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72952025-01-11T05:37:27.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ad5f6ed0-c738-40f1-8b8a-c663d14df52b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72962025-01-11T05:37:27.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ad5f6ed0-c738-40f1-8b8a-c663d14df52b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72972025-01-11T05:37:27.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ad5f6ed0-c738-40f1-8b8a-c663d14df52b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72982025-01-11T05:37:28.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee83cf31-0377-414e-b3e2-f7592ae30be4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
72992025-01-11T05:37:28.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee83cf31-0377-414e-b3e2-f7592ae30be4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73002025-01-11T05:37:28.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ee83cf31-0377-414e-b3e2-f7592ae30be4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73012025-01-11T05:37:29.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d2272e57-c13c-4c52-83cd-f2ea2b8ab3fa roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73022025-01-11T05:37:29.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d2272e57-c13c-4c52-83cd-f2ea2b8ab3fa resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73032025-01-11T05:37:29.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d2272e57-c13c-4c52-83cd-f2ea2b8ab3fa response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73042025-01-11T05:37:30.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
73052025-01-11T05:37:30.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73062025-01-11T05:37:30.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
73072025-01-11T05:37:30.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73082025-01-11T05:37:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73092025-01-11T05:37:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73102025-01-11T05:37:30.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73112025-01-11T05:37:30.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73122025-01-11T05:37:30.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73132025-01-11T05:37:30.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.983967ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73142025-01-11T05:37:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73152025-01-11T05:37:30.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73162025-01-11T05:37:30.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73172025-01-11T05:37:30.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73182025-01-11T05:37:30.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73192025-01-11T05:37:30.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73202025-01-11T05:37:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
73212025-01-11T05:37:30.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73222025-01-11T05:37:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73232025-01-11T05:37:30.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
73242025-01-11T05:37:30.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.957169ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
73252025-01-11T05:37:30.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f74ecbf-fa5a-4495-ba8e-39d120d06b4b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73262025-01-11T05:37:30.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f74ecbf-fa5a-4495-ba8e-39d120d06b4b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73272025-01-11T05:37:30.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f74ecbf-fa5a-4495-ba8e-39d120d06b4b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73282025-01-11T05:37:31.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fbf98940-153b-4d4c-afc0-a969db817417 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73292025-01-11T05:37:31.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fbf98940-153b-4d4c-afc0-a969db817417 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73302025-01-11T05:37:31.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fbf98940-153b-4d4c-afc0-a969db817417 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73312025-01-11T05:37:32.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f6968e81-8812-4267-be87-48a1e4aaa8c0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73322025-01-11T05:37:32.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f6968e81-8812-4267-be87-48a1e4aaa8c0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73332025-01-11T05:37:32.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f6968e81-8812-4267-be87-48a1e4aaa8c0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73342025-01-11T05:37:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 386a68b2-1d0c-466d-9083-df6aee64910d response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
73352025-01-11T05:37:33.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c0b93f6e-176e-4629-9565-ca57e1a765a3 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73362025-01-11T05:37:33.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c0b93f6e-176e-4629-9565-ca57e1a765a3 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73372025-01-11T05:37:33.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c0b93f6e-176e-4629-9565-ca57e1a765a3 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73382025-01-11T05:37:34.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ac395865-a1c0-4d10-a28c-1e966541d9d7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73392025-01-11T05:37:34.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ac395865-a1c0-4d10-a28c-1e966541d9d7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73402025-01-11T05:37:34.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ac395865-a1c0-4d10-a28c-1e966541d9d7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73412025-01-11T05:37:35.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5674b963-c8da-457b-af63-7c11d5677b40 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73422025-01-11T05:37:35.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5674b963-c8da-457b-af63-7c11d5677b40 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73432025-01-11T05:37:35.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5674b963-c8da-457b-af63-7c11d5677b40 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73442025-01-11T05:37:36.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73abb0bf-7386-486c-9682-25b55d72fba9 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73452025-01-11T05:37:36.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73abb0bf-7386-486c-9682-25b55d72fba9 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73462025-01-11T05:37:36.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 73abb0bf-7386-486c-9682-25b55d72fba9 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73472025-01-11T05:37:37.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f370428-e150-4d2a-82f8-60c0c00b417c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73482025-01-11T05:37:37.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f370428-e150-4d2a-82f8-60c0c00b417c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73492025-01-11T05:37:37.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4f370428-e150-4d2a-82f8-60c0c00b417c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73502025-01-11T05:37:38.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5bd12b94-dac8-4297-a4f1-83dc583e143d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73512025-01-11T05:37:38.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5bd12b94-dac8-4297-a4f1-83dc583e143d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73522025-01-11T05:37:38.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5bd12b94-dac8-4297-a4f1-83dc583e143d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73532025-01-11T05:37:40.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3dcfd5b-33c3-4fca-a9bd-2c947a75d85e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73542025-01-11T05:37:40.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3dcfd5b-33c3-4fca-a9bd-2c947a75d85e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73552025-01-11T05:37:40.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f3dcfd5b-33c3-4fca-a9bd-2c947a75d85e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
73562025-01-11T05:37:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
73572025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
73582025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73592025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
73602025-01-11T05:37:40.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:27:40.602024989 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
73612025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
73622025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
73632025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
73642025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
73652025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73662025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
73672025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
73682025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
73692025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
73702025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73712025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
73722025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73732025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
73742025-01-11T05:37:40.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
73752025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73762025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
73772025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
73782025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73792025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73802025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
73812025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73822025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
73832025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
73842025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73852025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
73862025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73872025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
73882025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73892025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
73902025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73912025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
73922025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73932025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
73942025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73952025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73962025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
73972025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
73982025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73992025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74002025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
74012025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74022025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
74032025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74042025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
74052025-01-11T05:37:40.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
74062025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.68\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
74072025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
74082025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
74092025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74102025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74112025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
74122025-01-11T05:37:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74132025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74142025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
74152025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74162025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
74172025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74182025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74192025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74202025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74212025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74222025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74232025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74242025-01-11T05:37:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74252025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74262025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
74272025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74282025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74292025-01-11T05:37:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1800, tv_nsec: 159505183 } })
74302025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74312025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74322025-01-11T05:37:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1800, tv_nsec: 159511624 } })
74332025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74342025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74352025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74362025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74372025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74382025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74392025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74402025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74412025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74422025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74432025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74442025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
74452025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.551114ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
74462025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
74472025-01-11T05:37:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.566094ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
74482025-01-11T05:37:40.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74492025-01-11T05:37:40.604ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.917413ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74502025-01-11T05:37:40.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74512025-01-11T05:37:40.605ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74522025-01-11T05:37:40.606ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:27:40.602024989 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
74532025-01-11T05:37:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.212993ms iteration = 15 status = {"expiration":"2025-01-11T05:27:40.602024989Z","pruned":[]}
74542025-01-11T05:37:40.606ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74552025-01-11T05:37:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74562025-01-11T05:37:40.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74572025-01-11T05:37:40.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74582025-01-11T05:37:40.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74592025-01-11T05:37:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74602025-01-11T05:37:40.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74612025-01-11T05:37:40.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74622025-01-11T05:37:40.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74632025-01-11T05:37:40.610ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.22026ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
74642025-01-11T05:37:40.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1800, tv_nsec: 167455397 } })
74652025-01-11T05:37:40.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
74662025-01-11T05:37:40.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74672025-01-11T05:37:40.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74682025-01-11T05:37:40.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74692025-01-11T05:37:40.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74702025-01-11T05:37:40.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74712025-01-11T05:37:40.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1800, tv_nsec: 173355776 } })
74722025-01-11T05:37:40.617ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
74732025-01-11T05:37:40.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74742025-01-11T05:37:40.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74752025-01-11T05:37:40.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74762025-01-11T05:37:40.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772025-01-11T05:37:40.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74782025-01-11T05:37:40.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74792025-01-11T05:37:40.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74802025-01-11T05:37:40.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74812025-01-11T05:37:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74822025-01-11T05:37:40.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74832025-01-11T05:37:40.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74842025-01-11T05:37:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74852025-01-11T05:37:40.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74862025-01-11T05:37:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74872025-01-11T05:37:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74882025-01-11T05:37:40.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
74902025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
74912025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
74922025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74932025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74942025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74952025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74962025-01-11T05:37:40.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74972025-01-11T05:37:40.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74982025-01-11T05:37:40.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74992025-01-11T05:37:40.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75002025-01-11T05:37:40.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75012025-01-11T05:37:40.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75022025-01-11T05:37:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75032025-01-11T05:37:40.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1800, tv_nsec: 194656353 } })
75042025-01-11T05:37:40.638ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
75052025-01-11T05:37:40.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75062025-01-11T05:37:40.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75072025-01-11T05:37:40.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 36.772005ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
75082025-01-11T05:37:40.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75092025-01-11T05:37:40.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75102025-01-11T05:37:40.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75112025-01-11T05:37:40.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75122025-01-11T05:37:40.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75132025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75142025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75152025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75162025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75172025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75182025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75192025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
75202025-01-11T05:37:40.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75212025-01-11T05:37:40.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75222025-01-11T05:37:40.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.882762ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75232025-01-11T05:37:40.652ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75242025-01-11T05:37:40.652ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75252025-01-11T05:37:40.652ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.926123ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75262025-01-11T05:37:40.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75272025-01-11T05:37:40.653ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
75282025-01-11T05:37:40.653ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
75292025-01-11T05:37:40.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75302025-01-11T05:37:40.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75312025-01-11T05:37:40.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75322025-01-11T05:37:40.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75332025-01-11T05:37:40.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75342025-01-11T05:37:40.657ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75352025-01-11T05:37:40.657ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75362025-01-11T05:37:40.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75372025-01-11T05:37:40.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75382025-01-11T05:37:40.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75392025-01-11T05:37:40.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75402025-01-11T05:37:40.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75412025-01-11T05:37:40.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75422025-01-11T05:37:40.660ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75432025-01-11T05:37:40.660ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75442025-01-11T05:37:40.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75452025-01-11T05:37:40.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75462025-01-11T05:37:40.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75472025-01-11T05:37:40.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75482025-01-11T05:37:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75492025-01-11T05:37:40.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75502025-01-11T05:37:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75512025-01-11T05:37:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75522025-01-11T05:37:40.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.122255ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
75532025-01-11T05:37:40.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75542025-01-11T05:37:40.665ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
75552025-01-11T05:37:40.665ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
75562025-01-11T05:37:40.665ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
75572025-01-11T05:37:40.665ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 63.342177ms iteration = 15 status = {"generation":2}
75582025-01-11T05:37:40.667ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
75592025-01-11T05:37:40.667ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
75602025-01-11T05:37:40.667ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.986263ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
75612025-01-11T05:37:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
75622025-01-11T05:37:40.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75632025-01-11T05:37:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75642025-01-11T05:37:40.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75652025-01-11T05:37:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75662025-01-11T05:37:40.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75672025-01-11T05:37:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75682025-01-11T05:37:40.674ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
75692025-01-11T05:37:40.674ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.14079ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
75702025-01-11T05:37:40.674ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
75712025-01-11T05:37:40.674ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
75722025-01-11T05:37:40.674ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
75732025-01-11T05:37:40.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75742025-01-11T05:37:40.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75752025-01-11T05:37:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75762025-01-11T05:37:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75772025-01-11T05:37:40.676ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75782025-01-11T05:37:40.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.422899ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75792025-01-11T05:37:40.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75802025-01-11T05:37:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75812025-01-11T05:37:40.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75822025-01-11T05:37:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75832025-01-11T05:37:40.682ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
75842025-01-11T05:37:40.682ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
75852025-01-11T05:37:40.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75862025-01-11T05:37:40.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75872025-01-11T05:37:40.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882025-01-11T05:37:40.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75892025-01-11T05:37:40.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75902025-01-11T05:37:40.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75912025-01-11T05:37:40.693ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
75922025-01-11T05:37:40.693ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
75932025-01-11T05:37:40.693ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
75942025-01-11T05:37:40.693ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 91.774419ms iteration = 15 status = {"generation":1}
75952025-01-11T05:37:40.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75962025-01-11T05:37:40.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75972025-01-11T05:37:40.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75982025-01-11T05:37:40.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75992025-01-11T05:37:40.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.960999ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76002025-01-11T05:37:40.698ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
76012025-01-11T05:37:40.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 95.879149ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
76022025-01-11T05:37:40.698ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.91713ms iteration = 32 status = {"physical_disks_added":0}
76032025-01-11T05:37:40.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76042025-01-11T05:37:40.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76052025-01-11T05:37:40.701ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
76062025-01-11T05:37:40.702ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76072025-01-11T05:37:40.702ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76082025-01-11T05:37:40.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.627713ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76092025-01-11T05:37:40.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76102025-01-11T05:37:40.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76112025-01-11T05:37:40.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122025-01-11T05:37:40.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76132025-01-11T05:37:40.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76142025-01-11T05:37:40.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152025-01-11T05:37:40.706ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.285623ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76162025-01-11T05:37:40.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
76172025-01-11T05:37:40.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76182025-01-11T05:37:40.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76192025-01-11T05:37:40.708ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
76202025-01-11T05:37:40.709ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.049844ms iteration = 29 status = 0
76212025-01-11T05:37:40.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76222025-01-11T05:37:40.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76232025-01-11T05:37:40.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76242025-01-11T05:37:40.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76252025-01-11T05:37:40.734ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76262025-01-11T05:37:40.735ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff9d1872-4611-4461-b580-ae06bc7715e0", "content-length": "26", "date": "Sat, 11 Jan 2025 05:37:40 GMT"} })
76272025-01-11T05:37:40.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76282025-01-11T05:37:40.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.245839ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
76292025-01-11T05:37:40.736ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76302025-01-11T05:37:40.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76312025-01-11T05:37:40.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76322025-01-11T05:37:40.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76332025-01-11T05:37:40.755ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
76342025-01-11T05:37:40.755ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 152.816955ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
76352025-01-11T05:37:40.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76362025-01-11T05:37:40.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76372025-01-11T05:37:40.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76382025-01-11T05:37:40.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76392025-01-11T05:37:40.756ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76402025-01-11T05:37:40.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76412025-01-11T05:37:40.756ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a254ba7a-ff12-4934-af4d-8bc5afe47419", "content-length": "26", "date": "Sat, 11 Jan 2025 05:37:40 GMT"} })
76422025-01-11T05:37:40.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76432025-01-11T05:37:40.758ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76442025-01-11T05:37:40.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76452025-01-11T05:37:40.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76462025-01-11T05:37:40.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76472025-01-11T05:37:40.783ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
76482025-01-11T05:37:40.783ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76492025-01-11T05:37:40.783ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2e90bb9-bc97-4637-98ab-a018b733f894", "content-length": "26", "date": "Sat, 11 Jan 2025 05:37:40 GMT"} })
76502025-01-11T05:37:40.783ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76512025-01-11T05:37:40.785ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
76522025-01-11T05:37:40.837ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
76532025-01-11T05:37:40.837ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c3f13c8e-ed47-479b-acc0-2e3ed8629f7a", "date": "Sat, 11 Jan 2025 05:37:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76542025-01-11T05:37:40.837ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76552025-01-11T05:37:40.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aeb689f4-2b78-4e4a-8be5-880a48c5e8f0", "date": "Sat, 11 Jan 2025 05:37:40 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76562025-01-11T05:37:40.839ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76572025-01-11T05:37:40.841ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76582025-01-11T05:37:40.841ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 239.308529ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
76592025-01-11T05:37:40.909ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76602025-01-11T05:37:40.909ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9e35d3a-f42a-49f9-82d8-0a6661e44a90", "content-length": "2", "date": "Sat, 11 Jan 2025 05:37:40 GMT"} })
76612025-01-11T05:37:40.910ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76622025-01-11T05:37:40.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76632025-01-11T05:37:40.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
76642025-01-11T05:37:41.015ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76652025-01-11T05:37:41.015ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76662025-01-11T05:37:41.016ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d8dae7f-14bd-4f35-8c66-e945d57aac2a", "content-length": "372", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
76672025-01-11T05:37:41.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76682025-01-11T05:37:41.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76692025-01-11T05:37:41.022ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.866721ms iteration = 29 status = null
76702025-01-11T05:37:41.030ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 428.357177ms iteration = 29 status = {}
76712025-01-11T05:37:41.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e803649c-7e41-487b-85c4-0d8128d0f337 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
76722025-01-11T05:37:41.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e803649c-7e41-487b-85c4-0d8128d0f337 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
76732025-01-11T05:37:41.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e803649c-7e41-487b-85c4-0d8128d0f337 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
76742025-01-11T05:37:41.075ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76752025-01-11T05:37:41.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76762025-01-11T05:37:41.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cfc26a7a-3d0e-4308-98b0-2c43eb0c304d", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
76772025-01-11T05:37:41.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76782025-01-11T05:37:41.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76792025-01-11T05:37:41.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76802025-01-11T05:37:41.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76812025-01-11T05:37:41.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76822025-01-11T05:37:41.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76832025-01-11T05:37:41.085ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76842025-01-11T05:37:41.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76852025-01-11T05:37:41.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bda9d233-6a90-4ff5-9353-d3c452afab3d", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
76862025-01-11T05:37:41.087ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 484.67751ms iteration = 30 status = {}
76872025-01-11T05:37:41.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76882025-01-11T05:37:41.103ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfed8801-a9b8-48ac-a2c4-cac0c648140b", "content-length": "691", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
76892025-01-11T05:37:41.103ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76902025-01-11T05:37:41.103ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76912025-01-11T05:37:41.103ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76922025-01-11T05:37:41.105ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 503.491172ms iteration = 30 status = {}
76932025-01-11T05:37:41.116ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
76942025-01-11T05:37:41.117ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e51ac73e-d690-4e03-b52e-72c69d9adad2", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76952025-01-11T05:37:41.117ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76962025-01-11T05:37:41.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "98985998-1190-4605-a60e-5c3974f56a9b", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76972025-01-11T05:37:41.118ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76982025-01-11T05:37:41.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "23c266f6-5011-4347-8a57-ff35eca87418", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76992025-01-11T05:37:41.120ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77002025-01-11T05:37:41.121ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77012025-01-11T05:37:41.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.497182ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77022025-01-11T05:37:41.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77032025-01-11T05:37:41.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77042025-01-11T05:37:41.167ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
77052025-01-11T05:37:41.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77062025-01-11T05:37:41.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77072025-01-11T05:37:41.176ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77082025-01-11T05:37:41.176ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "854103fa-9948-4ad4-a4b2-a7de8cc11e5c", "content-length": "134", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
77092025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77102025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
77112025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77122025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77132025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77142025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77152025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77162025-01-11T05:37:41.176ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77172025-01-11T05:37:41.177ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77182025-01-11T05:37:41.177ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77192025-01-11T05:37:41.177ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
77202025-01-11T05:37:41.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77212025-01-11T05:37:41.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77222025-01-11T05:37:41.179ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77232025-01-11T05:37:41.179ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f021a8fa-27a8-4f6e-b585-9805e4576971", "content-length": "2", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
77242025-01-11T05:37:41.179ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77252025-01-11T05:37:41.179ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5912e3fb-1179-467c-afeb-0ebf0e9a9205", "content-length": "52", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
77262025-01-11T05:37:41.179ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
77272025-01-11T05:37:41.179ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77282025-01-11T05:37:41.280ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c8e83f6a-09f2-4d70-8b3b-9b75bdb4c466", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
77292025-01-11T05:37:41.280ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
77302025-01-11T05:37:41.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77312025-01-11T05:37:41.280ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c8ae20e-9ce0-4340-9b05-7c418ede2250", "content-length": "682", "date": "Sat, 11 Jan 2025 05:37:41 GMT"} })
77322025-01-11T05:37:41.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77332025-01-11T05:37:41.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77342025-01-11T05:37:41.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77352025-01-11T05:37:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77362025-01-11T05:37:41.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77372025-01-11T05:37:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77382025-01-11T05:37:41.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77392025-01-11T05:37:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77402025-01-11T05:37:41.298ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 696.100729ms iteration = 29 status = {}
77412025-01-11T05:37:42.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9b946e21-ca77-4671-b674-3f36f053aeb2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77422025-01-11T05:37:42.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9b946e21-ca77-4671-b674-3f36f053aeb2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77432025-01-11T05:37:42.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 9b946e21-ca77-4671-b674-3f36f053aeb2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77442025-01-11T05:37:43.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdba0c11-084e-4a83-894a-814e85f42e54 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77452025-01-11T05:37:43.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdba0c11-084e-4a83-894a-814e85f42e54 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77462025-01-11T05:37:43.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdba0c11-084e-4a83-894a-814e85f42e54 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77472025-01-11T05:37:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 691 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 6f9eeaa0-7a17-45a3-aed3-06f7cfffd0fe response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
77482025-01-11T05:37:44.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5b806e2b-1e38-41c9-bca4-01c989e8006e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77492025-01-11T05:37:44.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5b806e2b-1e38-41c9-bca4-01c989e8006e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77502025-01-11T05:37:44.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5b806e2b-1e38-41c9-bca4-01c989e8006e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77512025-01-11T05:37:45.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 821e8578-3897-49eb-9a49-6cd77ad79a85 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77522025-01-11T05:37:45.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 821e8578-3897-49eb-9a49-6cd77ad79a85 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77532025-01-11T05:37:45.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 821e8578-3897-49eb-9a49-6cd77ad79a85 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77542025-01-11T05:37:45.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = edbcb6cf-86e3-4be7-8c7a-3823c372e375 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
77552025-01-11T05:37:45.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = edbcb6cf-86e3-4be7-8c7a-3823c372e375 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
77562025-01-11T05:37:45.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = edbcb6cf-86e3-4be7-8c7a-3823c372e375 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
77572025-01-11T05:37:46.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b91fa48c-8c37-462a-947b-080b8070632e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77582025-01-11T05:37:46.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b91fa48c-8c37-462a-947b-080b8070632e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77592025-01-11T05:37:46.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b91fa48c-8c37-462a-947b-080b8070632e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77602025-01-11T05:37:47.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a282c828-6139-4a9e-85a1-45908b78a12f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77612025-01-11T05:37:47.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a282c828-6139-4a9e-85a1-45908b78a12f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77622025-01-11T05:37:47.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a282c828-6139-4a9e-85a1-45908b78a12f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77632025-01-11T05:37:48.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 380ce04e-1bad-4060-8e4e-097675bdb4a0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77642025-01-11T05:37:48.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 380ce04e-1bad-4060-8e4e-097675bdb4a0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77652025-01-11T05:37:48.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 380ce04e-1bad-4060-8e4e-097675bdb4a0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77662025-01-11T05:37:49.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 967a149d-cb8b-4610-8262-ce167646488b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77672025-01-11T05:37:49.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 967a149d-cb8b-4610-8262-ce167646488b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77682025-01-11T05:37:49.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 967a149d-cb8b-4610-8262-ce167646488b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77692025-01-11T05:37:50.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3392194d-a4a6-47bc-8bda-9446b6121798 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77702025-01-11T05:37:50.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3392194d-a4a6-47bc-8bda-9446b6121798 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77712025-01-11T05:37:50.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3392194d-a4a6-47bc-8bda-9446b6121798 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77722025-01-11T05:37:50.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
77732025-01-11T05:37:50.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
77742025-01-11T05:37:50.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77752025-01-11T05:37:50.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77762025-01-11T05:37:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77772025-01-11T05:37:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77782025-01-11T05:37:50.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77792025-01-11T05:37:50.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77802025-01-11T05:37:50.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77812025-01-11T05:37:50.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77822025-01-11T05:37:50.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77832025-01-11T05:37:50.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77842025-01-11T05:37:50.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77852025-01-11T05:37:50.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77862025-01-11T05:37:50.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.380361ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77872025-01-11T05:37:50.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77882025-01-11T05:37:50.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
77892025-01-11T05:37:50.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77902025-01-11T05:37:50.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77912025-01-11T05:37:50.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
77922025-01-11T05:37:50.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.560304ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
77932025-01-11T05:37:51.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 30a0f3a3-cec4-4348-8384-91ee963ebe17 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77942025-01-11T05:37:51.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 30a0f3a3-cec4-4348-8384-91ee963ebe17 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77952025-01-11T05:37:51.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 30a0f3a3-cec4-4348-8384-91ee963ebe17 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77962025-01-11T05:37:52.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a03c49f5-185c-41bd-8dd5-ea7d3a2094ad roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77972025-01-11T05:37:52.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a03c49f5-185c-41bd-8dd5-ea7d3a2094ad resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77982025-01-11T05:37:52.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = a03c49f5-185c-41bd-8dd5-ea7d3a2094ad response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
77992025-01-11T05:37:53.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6a9794c5-807a-4a0a-960b-32d87a2f0804 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78002025-01-11T05:37:53.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6a9794c5-807a-4a0a-960b-32d87a2f0804 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78012025-01-11T05:37:53.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6a9794c5-807a-4a0a-960b-32d87a2f0804 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78022025-01-11T05:37:53.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = d596dc95-281f-4146-a4ed-157bcce3089e roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
78032025-01-11T05:37:53.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = d596dc95-281f-4146-a4ed-157bcce3089e resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
78042025-01-11T05:37:53.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = d596dc95-281f-4146-a4ed-157bcce3089e response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
78052025-01-11T05:37:53.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7daf5edb-35b7-4efb-9368-099ccc3575bf roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
78062025-01-11T05:37:53.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7daf5edb-35b7-4efb-9368-099ccc3575bf resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
78072025-01-11T05:37:53.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 7daf5edb-35b7-4efb-9368-099ccc3575bf response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
78082025-01-11T05:37:53.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 225fb87e-fc50-48ad-9b4b-e332a891b344 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
78092025-01-11T05:37:54.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c38f9d07-0616-4e01-bc6b-f26e1fea284b roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78102025-01-11T05:37:54.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c38f9d07-0616-4e01-bc6b-f26e1fea284b resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78112025-01-11T05:37:54.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c38f9d07-0616-4e01-bc6b-f26e1fea284b response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78122025-01-11T05:37:55.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 24b67745-38a8-4370-a127-65f3b72269a0 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78132025-01-11T05:37:55.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 24b67745-38a8-4370-a127-65f3b72269a0 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78142025-01-11T05:37:55.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 24b67745-38a8-4370-a127-65f3b72269a0 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78152025-01-11T05:37:56.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6c64b399-930d-4422-9d20-01e701a630a6 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78162025-01-11T05:37:56.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6c64b399-930d-4422-9d20-01e701a630a6 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78172025-01-11T05:37:56.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6c64b399-930d-4422-9d20-01e701a630a6 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78182025-01-11T05:37:57.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e751e95c-5999-4d3e-990a-20592df567ed roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78192025-01-11T05:37:57.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e751e95c-5999-4d3e-990a-20592df567ed resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78202025-01-11T05:37:57.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e751e95c-5999-4d3e-990a-20592df567ed response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78212025-01-11T05:37:58.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e731af39-3ccf-463b-8769-2f97ba89b9ec roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78222025-01-11T05:37:58.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e731af39-3ccf-463b-8769-2f97ba89b9ec resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78232025-01-11T05:37:58.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = e731af39-3ccf-463b-8769-2f97ba89b9ec response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78242025-01-11T05:37:59.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec23c53d-a1ce-4a0b-ab53-ca82b4cfc242 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78252025-01-11T05:37:59.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec23c53d-a1ce-4a0b-ab53-ca82b4cfc242 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78262025-01-11T05:37:59.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec23c53d-a1ce-4a0b-ab53-ca82b4cfc242 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78272025-01-11T05:38:00.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 350da410-ab49-405f-ade3-be8f6a910242 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78282025-01-11T05:38:00.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 350da410-ab49-405f-ade3-be8f6a910242 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78292025-01-11T05:38:00.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 350da410-ab49-405f-ade3-be8f6a910242 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78302025-01-11T05:38:00.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
78312025-01-11T05:38:00.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
78322025-01-11T05:38:00.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78332025-01-11T05:38:00.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78342025-01-11T05:38:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78352025-01-11T05:38:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78362025-01-11T05:38:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372025-01-11T05:38:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78382025-01-11T05:38:00.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78392025-01-11T05:38:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78402025-01-11T05:38:00.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78412025-01-11T05:38:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78422025-01-11T05:38:00.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78432025-01-11T05:38:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
78442025-01-11T05:38:00.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78452025-01-11T05:38:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78462025-01-11T05:38:00.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
78472025-01-11T05:38:00.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.586108ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
78482025-01-11T05:38:00.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78492025-01-11T05:38:00.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78502025-01-11T05:38:00.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.702703ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78512025-01-11T05:38:01.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 056451e0-d6ae-420b-9ae6-98550ff7c945 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78522025-01-11T05:38:01.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 056451e0-d6ae-420b-9ae6-98550ff7c945 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78532025-01-11T05:38:01.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 056451e0-d6ae-420b-9ae6-98550ff7c945 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78542025-01-11T05:38:02.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 918e8a7f-d901-4029-ae31-7ca10eeb8473 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78552025-01-11T05:38:02.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 918e8a7f-d901-4029-ae31-7ca10eeb8473 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78562025-01-11T05:38:02.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 918e8a7f-d901-4029-ae31-7ca10eeb8473 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78572025-01-11T05:38:03.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8a3a9f0b-2ab0-4f8e-9723-87eb3aa848b2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78582025-01-11T05:38:03.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8a3a9f0b-2ab0-4f8e-9723-87eb3aa848b2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78592025-01-11T05:38:03.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8a3a9f0b-2ab0-4f8e-9723-87eb3aa848b2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78602025-01-11T05:38:03.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 1852f714-ac48-4e80-8cd2-cba3dfbebef3 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
78612025-01-11T05:38:04.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 11335ea9-0500-44d6-a704-f42c6ea0c2ef roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78622025-01-11T05:38:04.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 11335ea9-0500-44d6-a704-f42c6ea0c2ef resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78632025-01-11T05:38:04.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 11335ea9-0500-44d6-a704-f42c6ea0c2ef response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78642025-01-11T05:38:05.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec198192-f59c-43b0-878e-87d0d2d56907 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78652025-01-11T05:38:05.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec198192-f59c-43b0-878e-87d0d2d56907 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78662025-01-11T05:38:05.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ec198192-f59c-43b0-878e-87d0d2d56907 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78672025-01-11T05:38:06.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5486a2ec-6dbd-4ddb-9a9c-c6de12718f76 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78682025-01-11T05:38:06.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5486a2ec-6dbd-4ddb-9a9c-c6de12718f76 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78692025-01-11T05:38:06.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5486a2ec-6dbd-4ddb-9a9c-c6de12718f76 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78702025-01-11T05:38:07.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6dfc7234-ad75-432a-9e32-cb7b43cfbdc7 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78712025-01-11T05:38:07.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6dfc7234-ad75-432a-9e32-cb7b43cfbdc7 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78722025-01-11T05:38:07.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6dfc7234-ad75-432a-9e32-cb7b43cfbdc7 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78732025-01-11T05:38:08.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2347597b-03ed-4538-a79c-5cffb51fdc08 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78742025-01-11T05:38:08.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2347597b-03ed-4538-a79c-5cffb51fdc08 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78752025-01-11T05:38:08.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2347597b-03ed-4538-a79c-5cffb51fdc08 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78762025-01-11T05:38:09.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6f4187f6-e432-40df-a209-3f559d0a8970 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78772025-01-11T05:38:09.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6f4187f6-e432-40df-a209-3f559d0a8970 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78782025-01-11T05:38:09.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6f4187f6-e432-40df-a209-3f559d0a8970 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
78792025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
78802025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
78812025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78822025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78832025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
78842025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
78852025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78862025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78872025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
78882025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78892025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
78902025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78912025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
78922025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78932025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78942025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
78952025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78962025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
78972025-01-11T05:38:10.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78982025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78992025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
79002025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
79012025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79022025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79032025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
79042025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
79052025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79062025-01-11T05:38:10.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
79072025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
79082025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79092025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79102025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
79112025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79122025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79132025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79142025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79152025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79162025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79172025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79182025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79192025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79202025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79212025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79222025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79232025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79242025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79252025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79262025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79272025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
79282025-01-11T05:38:10.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79292025-01-11T05:38:10.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79302025-01-11T05:38:10.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.737229ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
79312025-01-11T05:38:10.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79322025-01-11T05:38:10.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.485158ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79332025-01-11T05:38:10.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1830, tv_nsec: 163159649 } })
79342025-01-11T05:38:10.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
79352025-01-11T05:38:10.606ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79362025-01-11T05:38:10.607ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79372025-01-11T05:38:10.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79382025-01-11T05:38:10.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79392025-01-11T05:38:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79402025-01-11T05:38:10.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79412025-01-11T05:38:10.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79422025-01-11T05:38:10.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79432025-01-11T05:38:10.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1830, tv_nsec: 167507905 } })
79442025-01-11T05:38:10.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79452025-01-11T05:38:10.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
79462025-01-11T05:38:10.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79472025-01-11T05:38:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79482025-01-11T05:38:10.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79492025-01-11T05:38:10.614ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79502025-01-11T05:38:10.614ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79512025-01-11T05:38:10.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79522025-01-11T05:38:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79532025-01-11T05:38:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79542025-01-11T05:38:10.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79552025-01-11T05:38:10.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79562025-01-11T05:38:10.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79572025-01-11T05:38:10.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.473247ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79582025-01-11T05:38:10.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.075972ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79592025-01-11T05:38:10.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79602025-01-11T05:38:10.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79612025-01-11T05:38:10.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79622025-01-11T05:38:10.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79632025-01-11T05:38:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79642025-01-11T05:38:10.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79652025-01-11T05:38:10.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79662025-01-11T05:38:10.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79672025-01-11T05:38:10.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79682025-01-11T05:38:10.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.661961ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
79692025-01-11T05:38:10.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79702025-01-11T05:38:10.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79712025-01-11T05:38:10.654ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79722025-01-11T05:38:10.654ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79732025-01-11T05:38:10.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 53.132543ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79742025-01-11T05:38:10.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79752025-01-11T05:38:10.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79762025-01-11T05:38:10.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79772025-01-11T05:38:10.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79782025-01-11T05:38:10.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79792025-01-11T05:38:10.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79802025-01-11T05:38:10.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79812025-01-11T05:38:10.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79822025-01-11T05:38:10.658ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1830, tv_nsec: 215130907 } })
79832025-01-11T05:38:10.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79842025-01-11T05:38:10.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79852025-01-11T05:38:10.658ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
79862025-01-11T05:38:10.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79872025-01-11T05:38:10.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79882025-01-11T05:38:10.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79892025-01-11T05:38:10.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79902025-01-11T05:38:10.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79912025-01-11T05:38:10.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79922025-01-11T05:38:10.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79932025-01-11T05:38:10.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79942025-01-11T05:38:10.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
79952025-01-11T05:38:10.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79962025-01-11T05:38:10.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79972025-01-11T05:38:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79982025-01-11T05:38:10.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79992025-01-11T05:38:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80002025-01-11T05:38:10.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80012025-01-11T05:38:10.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80022025-01-11T05:38:10.677ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
80032025-01-11T05:38:10.677ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.663006ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
80042025-01-11T05:38:10.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80052025-01-11T05:38:10.678ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80062025-01-11T05:38:10.678ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7912b1b-25a2-4082-9f03-16e1f528d5cc", "content-length": "26", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80072025-01-11T05:38:10.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80082025-01-11T05:38:10.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80092025-01-11T05:38:10.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80102025-01-11T05:38:10.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80112025-01-11T05:38:10.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122025-01-11T05:38:10.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
80132025-01-11T05:38:10.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80142025-01-11T05:38:10.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80152025-01-11T05:38:10.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.871968ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80162025-01-11T05:38:10.686ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.92625ms iteration = 30 status = 0
80172025-01-11T05:38:10.693ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80182025-01-11T05:38:10.693ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80192025-01-11T05:38:10.693ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a283207-1f2a-45db-8d5a-e5b9df1fda8e", "content-length": "26", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80202025-01-11T05:38:10.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80212025-01-11T05:38:10.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80222025-01-11T05:38:10.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80232025-01-11T05:38:10.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.980307ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80242025-01-11T05:38:10.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80252025-01-11T05:38:10.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80262025-01-11T05:38:10.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80272025-01-11T05:38:10.699ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80282025-01-11T05:38:10.699ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.353791ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80292025-01-11T05:38:10.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80302025-01-11T05:38:10.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80312025-01-11T05:38:10.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
80322025-01-11T05:38:10.729ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80332025-01-11T05:38:10.729ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "493cb6ab-a145-4094-81ce-0cad49316102", "content-length": "26", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80342025-01-11T05:38:10.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80352025-01-11T05:38:10.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
80362025-01-11T05:38:10.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80372025-01-11T05:38:10.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "00f13fc1-a0c3-4b3d-8a6b-fd74d1276c9c", "content-length": "2", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80382025-01-11T05:38:10.758ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80392025-01-11T05:38:10.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80402025-01-11T05:38:10.760ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.729255ms iteration = 33 status = {"physical_disks_added":0}
80412025-01-11T05:38:10.763ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 161.728301ms iteration = 30 status = null
80422025-01-11T05:38:10.769ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 167.943397ms iteration = 30 status = {}
80432025-01-11T05:38:10.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 16deea7e-8995-4353-a650-e5396ed2b437 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
80442025-01-11T05:38:10.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 16deea7e-8995-4353-a650-e5396ed2b437 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
80452025-01-11T05:38:10.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 16deea7e-8995-4353-a650-e5396ed2b437 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
80462025-01-11T05:38:10.810ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80472025-01-11T05:38:10.810ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80482025-01-11T05:38:10.812ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "80592b11-5ee5-4ee4-a12b-ccc0943ea887", "content-length": "372", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80492025-01-11T05:38:10.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80502025-01-11T05:38:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80512025-01-11T05:38:10.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80522025-01-11T05:38:10.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80532025-01-11T05:38:10.860ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80542025-01-11T05:38:10.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80552025-01-11T05:38:10.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f1d75d05-5311-4155-b001-1888c43e1bb0", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80562025-01-11T05:38:10.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80572025-01-11T05:38:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80582025-01-11T05:38:10.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80592025-01-11T05:38:10.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80602025-01-11T05:38:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80612025-01-11T05:38:10.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80622025-01-11T05:38:10.865ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
80632025-01-11T05:38:10.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80642025-01-11T05:38:10.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80652025-01-11T05:38:10.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80662025-01-11T05:38:10.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80672025-01-11T05:38:10.869ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80682025-01-11T05:38:10.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80692025-01-11T05:38:10.869ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2c85cda2-40c0-4830-b309-f7a3bd49e70f", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80702025-01-11T05:38:10.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80712025-01-11T05:38:10.871ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.51044ms iteration = 31 status = {}
80722025-01-11T05:38:10.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80732025-01-11T05:38:10.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80742025-01-11T05:38:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80752025-01-11T05:38:10.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80762025-01-11T05:38:10.876ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80772025-01-11T05:38:10.876ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4979b5c-0da1-46d7-b0dc-1fb0193201dc", "content-length": "134", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80782025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80792025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
80802025-01-11T05:38:10.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80812025-01-11T05:38:10.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80822025-01-11T05:38:10.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80832025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80842025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80852025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80862025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80872025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80882025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80892025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80902025-01-11T05:38:10.876ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80912025-01-11T05:38:10.877ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
80922025-01-11T05:38:10.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80932025-01-11T05:38:10.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80942025-01-11T05:38:10.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80952025-01-11T05:38:10.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "df862c90-1ecc-4d32-b71f-47cd3c2d42e0", "content-length": "2", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80962025-01-11T05:38:10.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80972025-01-11T05:38:10.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "462b24c7-a438-4bc2-96eb-5337e536e10b", "content-length": "52", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
80982025-01-11T05:38:10.880ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
80992025-01-11T05:38:10.880ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81002025-01-11T05:38:10.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81012025-01-11T05:38:10.983ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dbbab83e-153b-4e42-a26a-04e3aa58d88a", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
81022025-01-11T05:38:10.983ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
81032025-01-11T05:38:10.983ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81042025-01-11T05:38:10.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "27ba52cc-fb34-4c8d-8f00-046eea233763", "content-length": "691", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
81052025-01-11T05:38:10.984ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81062025-01-11T05:38:10.984ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81072025-01-11T05:38:10.984ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81082025-01-11T05:38:10.984ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb77b33-60a5-4710-9e34-566d17c1b5a8", "content-length": "682", "date": "Sat, 11 Jan 2025 05:38:10 GMT"} })
81092025-01-11T05:38:10.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81102025-01-11T05:38:10.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81112025-01-11T05:38:10.985ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 383.991446ms iteration = 31 status = {}
81122025-01-11T05:38:10.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81132025-01-11T05:38:10.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81142025-01-11T05:38:10.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81152025-01-11T05:38:10.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81162025-01-11T05:38:10.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81172025-01-11T05:38:10.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81182025-01-11T05:38:11.000ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 398.715258ms iteration = 30 status = {}
81192025-01-11T05:38:11.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ba725eac-7239-4721-b2a4-4fb94fc0c729 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81202025-01-11T05:38:11.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ba725eac-7239-4721-b2a4-4fb94fc0c729 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81212025-01-11T05:38:11.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ba725eac-7239-4721-b2a4-4fb94fc0c729 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81222025-01-11T05:38:12.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5875ece9-24d8-4e97-b5a8-da5f09531d35 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81232025-01-11T05:38:12.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5875ece9-24d8-4e97-b5a8-da5f09531d35 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81242025-01-11T05:38:12.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5875ece9-24d8-4e97-b5a8-da5f09531d35 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81252025-01-11T05:38:13.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 687 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 59eac52e-d7e1-42ac-ac99-0fd32c6cd053 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
81262025-01-11T05:38:13.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c581a4e8-2edc-4a83-b583-523ce9eb1ecd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81272025-01-11T05:38:13.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c581a4e8-2edc-4a83-b583-523ce9eb1ecd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81282025-01-11T05:38:13.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c581a4e8-2edc-4a83-b583-523ce9eb1ecd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81292025-01-11T05:38:14.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7c0e74bf-0a3c-40d9-81b4-00220783a91a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81302025-01-11T05:38:14.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7c0e74bf-0a3c-40d9-81b4-00220783a91a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81312025-01-11T05:38:14.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7c0e74bf-0a3c-40d9-81b4-00220783a91a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81322025-01-11T05:38:15.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = d8223394-f95a-4ad6-a35a-2a31c956d2c1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
81332025-01-11T05:38:15.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = d8223394-f95a-4ad6-a35a-2a31c956d2c1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
81342025-01-11T05:38:15.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47341 req_id = d8223394-f95a-4ad6-a35a-2a31c956d2c1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
81352025-01-11T05:38:15.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2bcc217f-1531-495e-82b1-8f167556bbcd roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81362025-01-11T05:38:15.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2bcc217f-1531-495e-82b1-8f167556bbcd resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81372025-01-11T05:38:15.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2bcc217f-1531-495e-82b1-8f167556bbcd response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81382025-01-11T05:38:16.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = be8b1e46-54f7-4abb-8266-bd67bcb6db26 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81392025-01-11T05:38:16.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = be8b1e46-54f7-4abb-8266-bd67bcb6db26 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81402025-01-11T05:38:16.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = be8b1e46-54f7-4abb-8266-bd67bcb6db26 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81412025-01-11T05:38:18.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 71b96b2a-5d3d-4203-8775-0a0651ea019e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81422025-01-11T05:38:18.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 71b96b2a-5d3d-4203-8775-0a0651ea019e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81432025-01-11T05:38:18.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 71b96b2a-5d3d-4203-8775-0a0651ea019e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81442025-01-11T05:38:19.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ce059a17-fc39-4524-a0e7-6271429edd83 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81452025-01-11T05:38:19.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ce059a17-fc39-4524-a0e7-6271429edd83 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81462025-01-11T05:38:19.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = ce059a17-fc39-4524-a0e7-6271429edd83 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81472025-01-11T05:38:20.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 890a678f-953d-4c9a-8f6c-f8cdc736159c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81482025-01-11T05:38:20.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 890a678f-953d-4c9a-8f6c-f8cdc736159c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81492025-01-11T05:38:20.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 890a678f-953d-4c9a-8f6c-f8cdc736159c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81502025-01-11T05:38:20.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
81512025-01-11T05:38:20.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
81522025-01-11T05:38:20.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81532025-01-11T05:38:20.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542025-01-11T05:38:20.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81552025-01-11T05:38:20.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81562025-01-11T05:38:20.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81572025-01-11T05:38:20.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81582025-01-11T05:38:20.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81592025-01-11T05:38:20.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81602025-01-11T05:38:20.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81612025-01-11T05:38:20.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81622025-01-11T05:38:20.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81632025-01-11T05:38:20.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
81642025-01-11T05:38:20.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81652025-01-11T05:38:20.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81662025-01-11T05:38:20.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
81672025-01-11T05:38:20.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.232761ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
81682025-01-11T05:38:20.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81692025-01-11T05:38:20.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81702025-01-11T05:38:20.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.899735ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81712025-01-11T05:38:21.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5f950b5b-2bfd-405d-8826-a78857ce96a2 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81722025-01-11T05:38:21.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5f950b5b-2bfd-405d-8826-a78857ce96a2 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81732025-01-11T05:38:21.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 5f950b5b-2bfd-405d-8826-a78857ce96a2 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81742025-01-11T05:38:22.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8adb38c4-0990-471e-a5f3-937403660eef roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81752025-01-11T05:38:22.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8adb38c4-0990-471e-a5f3-937403660eef resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81762025-01-11T05:38:22.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 8adb38c4-0990-471e-a5f3-937403660eef response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81772025-01-11T05:38:23.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 288db51a-c618-4102-beda-a81e03eb9e5f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81782025-01-11T05:38:23.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 288db51a-c618-4102-beda-a81e03eb9e5f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81792025-01-11T05:38:23.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 288db51a-c618-4102-beda-a81e03eb9e5f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81802025-01-11T05:38:23.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8fd4ab11-1b76-492a-ac8e-4e0029c5cb07 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
81812025-01-11T05:38:23.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8fd4ab11-1b76-492a-ac8e-4e0029c5cb07 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
81822025-01-11T05:38:23.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 8fd4ab11-1b76-492a-ac8e-4e0029c5cb07 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?sort_by=id_ascending
81832025-01-11T05:38:23.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 87bc8296-c179-4545-bf53-e13d1af19bc0 roles = RoleSet { roles: {} } uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
81842025-01-11T05:38:23.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 87bc8296-c179-4545-bf53-e13d1af19bc0 resource = Database result = Ok(()) uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
81852025-01-11T05:38:23.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40613 req_id = 87bc8296-c179-4545-bf53-e13d1af19bc0 response_code = 200 uri = /metrics/collectors/68ba0762-4eeb-4568-8923-69d504e34a00/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjViNTljNS02NzYzLTRiMjQtOTk3NS1iMzQwNTQwYjM3ODgifX0%3D
81862025-01-11T05:38:23.782ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 596 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = f6645d0c-b4d8-4286-8c5d-7f14e89a43de response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
81872025-01-11T05:38:24.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2c30e411-db4b-4e8f-8138-e2408eeef935 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81882025-01-11T05:38:24.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2c30e411-db4b-4e8f-8138-e2408eeef935 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81892025-01-11T05:38:24.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 2c30e411-db4b-4e8f-8138-e2408eeef935 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81902025-01-11T05:38:25.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 59e48d2a-ea27-48aa-a16f-0209c5c089f4 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81912025-01-11T05:38:25.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 59e48d2a-ea27-48aa-a16f-0209c5c089f4 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81922025-01-11T05:38:25.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 59e48d2a-ea27-48aa-a16f-0209c5c089f4 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81932025-01-11T05:38:26.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f1eabb0-79fe-48eb-b1fa-f610cde6556e roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81942025-01-11T05:38:26.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f1eabb0-79fe-48eb-b1fa-f610cde6556e resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81952025-01-11T05:38:26.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 0f1eabb0-79fe-48eb-b1fa-f610cde6556e response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81962025-01-11T05:38:27.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = daa1582c-facc-44e3-b161-166032fae22f roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81972025-01-11T05:38:27.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = daa1582c-facc-44e3-b161-166032fae22f resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81982025-01-11T05:38:27.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = daa1582c-facc-44e3-b161-166032fae22f response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
81992025-01-11T05:38:28.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1cdf7a06-268d-4ef4-a74c-f4a25fcb214d roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82002025-01-11T05:38:28.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1cdf7a06-268d-4ef4-a74c-f4a25fcb214d resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82012025-01-11T05:38:28.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1cdf7a06-268d-4ef4-a74c-f4a25fcb214d response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82022025-01-11T05:38:29.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cca83357-7a42-4f30-b5ab-0999e0e77934 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82032025-01-11T05:38:29.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cca83357-7a42-4f30-b5ab-0999e0e77934 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82042025-01-11T05:38:29.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = cca83357-7a42-4f30-b5ab-0999e0e77934 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82052025-01-11T05:38:30.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4780780d-5656-483d-8176-2dab75d9be9c roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82062025-01-11T05:38:30.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4780780d-5656-483d-8176-2dab75d9be9c resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82072025-01-11T05:38:30.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 4780780d-5656-483d-8176-2dab75d9be9c response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82082025-01-11T05:38:30.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
82092025-01-11T05:38:30.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
82102025-01-11T05:38:30.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82112025-01-11T05:38:30.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82122025-01-11T05:38:30.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82132025-01-11T05:38:30.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82142025-01-11T05:38:30.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82152025-01-11T05:38:30.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82162025-01-11T05:38:30.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82172025-01-11T05:38:30.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82182025-01-11T05:38:30.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82192025-01-11T05:38:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82202025-01-11T05:38:30.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82212025-01-11T05:38:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
82222025-01-11T05:38:30.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82232025-01-11T05:38:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82242025-01-11T05:38:30.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
82252025-01-11T05:38:30.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.073105ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
82262025-01-11T05:38:30.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82272025-01-11T05:38:30.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82282025-01-11T05:38:30.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.166867ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82292025-01-11T05:38:31.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 40d6dc7a-ba2d-41b9-b589-bd9089551235 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82302025-01-11T05:38:31.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 40d6dc7a-ba2d-41b9-b589-bd9089551235 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82312025-01-11T05:38:31.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 40d6dc7a-ba2d-41b9-b589-bd9089551235 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82322025-01-11T05:38:32.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f87f8726-d2c9-455b-a907-fe42e7a015c5 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82332025-01-11T05:38:32.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f87f8726-d2c9-455b-a907-fe42e7a015c5 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82342025-01-11T05:38:32.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = f87f8726-d2c9-455b-a907-fe42e7a015c5 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82352025-01-11T05:38:33.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b58df51f-cb30-4e4c-ab87-1afbc485582a roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82362025-01-11T05:38:33.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b58df51f-cb30-4e4c-ab87-1afbc485582a resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82372025-01-11T05:38:33.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = b58df51f-cb30-4e4c-ab87-1afbc485582a response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82382025-01-11T05:38:33.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 4a340001-d3a0-4260-abac-e72910a49e57 response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
82392025-01-11T05:38:34.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 123ee7fb-1d6c-453b-8e59-82469700e288 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82402025-01-11T05:38:34.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 123ee7fb-1d6c-453b-8e59-82469700e288 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82412025-01-11T05:38:34.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 123ee7fb-1d6c-453b-8e59-82469700e288 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82422025-01-11T05:38:35.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 384ac87d-2c9f-467a-b822-cd203d51c9d8 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82432025-01-11T05:38:35.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 384ac87d-2c9f-467a-b822-cd203d51c9d8 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82442025-01-11T05:38:35.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 384ac87d-2c9f-467a-b822-cd203d51c9d8 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82452025-01-11T05:38:36.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c494f47e-a064-4771-8a63-33b45409d290 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82462025-01-11T05:38:36.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c494f47e-a064-4771-8a63-33b45409d290 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82472025-01-11T05:38:36.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = c494f47e-a064-4771-8a63-33b45409d290 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82482025-01-11T05:38:37.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6b7db1c6-3873-4087-9470-eec5ef8ea898 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82492025-01-11T05:38:37.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6b7db1c6-3873-4087-9470-eec5ef8ea898 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82502025-01-11T05:38:37.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 6b7db1c6-3873-4087-9470-eec5ef8ea898 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82512025-01-11T05:38:38.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1bea55c4-7d2a-4b74-856a-88975b7f1e12 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82522025-01-11T05:38:38.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1bea55c4-7d2a-4b74-856a-88975b7f1e12 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82532025-01-11T05:38:38.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1bea55c4-7d2a-4b74-856a-88975b7f1e12 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82542025-01-11T05:38:39.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7a3299d6-7d61-45cc-b501-7dcb1b8b9445 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82552025-01-11T05:38:39.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7a3299d6-7d61-45cc-b501-7dcb1b8b9445 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82562025-01-11T05:38:39.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 7a3299d6-7d61-45cc-b501-7dcb1b8b9445 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82572025-01-11T05:38:40.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d5ce9dca-e447-488d-ab20-f321e760cc66 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82582025-01-11T05:38:40.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d5ce9dca-e447-488d-ab20-f321e760cc66 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82592025-01-11T05:38:40.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = d5ce9dca-e447-488d-ab20-f321e760cc66 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
82602025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
82612025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
82622025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82632025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82642025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
82652025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82662025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
82672025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82682025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
82692025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82702025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
82712025-01-11T05:38:40.601ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
82722025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82732025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82742025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
82752025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82762025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82772025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
82782025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
82792025-01-11T05:38:40.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = f55ba25b-688b-46fa-9852-2b5410def120
82802025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.52\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"f55ba25b-688b-46fa-9852-2b5410def120"}
82812025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
82822025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
82832025-01-11T05:38:40.601ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
82842025-01-11T05:38:40.601ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-11 05:28:40.601797416 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82852025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82862025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82872025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
82882025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
82892025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82902025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
82912025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82922025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
82932025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82942025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82952025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
82962025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82972025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
82982025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
82992025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83002025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
83012025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83022025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
83032025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83042025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
83052025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
83062025-01-11T05:38:40.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83072025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83082025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
83092025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
83102025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83112025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83122025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
83132025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83142025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
83152025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
83162025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83172025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83182025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
83192025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83202025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83212025-01-11T05:38:40.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83222025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
83232025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
83242025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83252025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83262025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
83272025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83282025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83292025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83302025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83312025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83322025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83332025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83342025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83352025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83362025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
83372025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83382025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83392025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83402025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83412025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
83422025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83432025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
83442025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83452025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83462025-01-11T05:38:40.602ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4266b46f-6e12-4383-943a-1dff6b37826d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50be0e3a-9e97-45f3-9749-f7daddfbf5a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1860, tv_nsec: 159386519 } })
83472025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83482025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83492025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83502025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83512025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83522025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83532025-01-11T05:38:40.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83542025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83552025-01-11T05:38:40.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("303fb0cc-e422-47d6-8616-7ec0e50b5a57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3b21afb4-ce4d-45e0-b3a8-12b276a4be3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66d1c1d6-834d-4ba2-9bb4-06a80946733b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1860, tv_nsec: 159448450 } })
83562025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83572025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83582025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83592025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83602025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
83612025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.35762ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
83622025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
83632025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.322929ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
83642025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83652025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83662025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83672025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83682025-01-11T05:38:40.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83692025-01-11T05:38:40.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83702025-01-11T05:38:40.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83712025-01-11T05:38:40.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.288534ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83722025-01-11T05:38:40.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83732025-01-11T05:38:40.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83742025-01-11T05:38:40.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1860, tv_nsec: 163699983 } })
83752025-01-11T05:38:40.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
83762025-01-11T05:38:40.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.443969ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
83772025-01-11T05:38:40.609ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83782025-01-11T05:38:40.609ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83792025-01-11T05:38:40.609ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.583056ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83802025-01-11T05:38:40.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1860, tv_nsec: 167761662 } })
83812025-01-11T05:38:40.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
83822025-01-11T05:38:40.611ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-11 05:28:40.601797416 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83832025-01-11T05:38:40.611ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.019269ms iteration = 16 status = {"expiration":"2025-01-11T05:28:40.601797416Z","pruned":[]}
83842025-01-11T05:38:40.612ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.186183ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
83852025-01-11T05:38:40.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83862025-01-11T05:38:40.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83872025-01-11T05:38:40.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83882025-01-11T05:38:40.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83892025-01-11T05:38:40.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83902025-01-11T05:38:40.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83912025-01-11T05:38:40.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83922025-01-11T05:38:40.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83932025-01-11T05:38:40.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83942025-01-11T05:38:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83952025-01-11T05:38:40.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83962025-01-11T05:38:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83972025-01-11T05:38:40.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83982025-01-11T05:38:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83992025-01-11T05:38:40.624ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
84002025-01-11T05:38:40.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
84012025-01-11T05:38:40.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84022025-01-11T05:38:40.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84032025-01-11T05:38:40.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84042025-01-11T05:38:40.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84052025-01-11T05:38:40.627ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84062025-01-11T05:38:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84072025-01-11T05:38:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
84082025-01-11T05:38:40.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
84092025-01-11T05:38:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
84102025-01-11T05:38:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84112025-01-11T05:38:40.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84122025-01-11T05:38:40.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84132025-01-11T05:38:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84142025-01-11T05:38:40.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84152025-01-11T05:38:40.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84162025-01-11T05:38:40.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84172025-01-11T05:38:40.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84182025-01-11T05:38:40.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84192025-01-11T05:38:40.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84202025-01-11T05:38:40.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84212025-01-11T05:38:40.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84222025-01-11T05:38:40.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84232025-01-11T05:38:40.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84242025-01-11T05:38:40.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84252025-01-11T05:38:40.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84262025-01-11T05:38:40.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84272025-01-11T05:38:40.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84282025-01-11T05:38:40.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84292025-01-11T05:38:40.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84302025-01-11T05:38:40.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84312025-01-11T05:38:40.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84322025-01-11T05:38:40.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332025-01-11T05:38:40.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84342025-01-11T05:38:40.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84352025-01-11T05:38:40.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84362025-01-11T05:38:40.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84372025-01-11T05:38:40.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84382025-01-11T05:38:40.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84392025-01-11T05:38:40.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84402025-01-11T05:38:40.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84412025-01-11T05:38:40.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422025-01-11T05:38:40.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84432025-01-11T05:38:40.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84442025-01-11T05:38:40.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84452025-01-11T05:38:40.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84462025-01-11T05:38:40.662ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84472025-01-11T05:38:40.662ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84482025-01-11T05:38:40.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84492025-01-11T05:38:40.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84502025-01-11T05:38:40.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84512025-01-11T05:38:40.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84522025-01-11T05:38:40.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84532025-01-11T05:38:40.663ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84542025-01-11T05:38:40.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.327294ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
84552025-01-11T05:38:40.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84562025-01-11T05:38:40.664ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84572025-01-11T05:38:40.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84582025-01-11T05:38:40.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84592025-01-11T05:38:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84602025-01-11T05:38:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84612025-01-11T05:38:40.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84622025-01-11T05:38:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84632025-01-11T05:38:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
84642025-01-11T05:38:40.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
84652025-01-11T05:38:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
84662025-01-11T05:38:40.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84672025-01-11T05:38:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
84682025-01-11T05:38:40.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
84692025-01-11T05:38:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
84702025-01-11T05:38:40.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84712025-01-11T05:38:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84722025-01-11T05:38:40.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84732025-01-11T05:38:40.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84742025-01-11T05:38:40.677ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1860, tv_nsec: 233743357 } })
84752025-01-11T05:38:40.677ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
84762025-01-11T05:38:40.677ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84772025-01-11T05:38:40.677ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84782025-01-11T05:38:40.677ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84792025-01-11T05:38:40.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84802025-01-11T05:38:40.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84812025-01-11T05:38:40.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84822025-01-11T05:38:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84832025-01-11T05:38:40.678ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84842025-01-11T05:38:40.678ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84852025-01-11T05:38:40.678ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.70605ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84862025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84872025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84882025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84892025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84902025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84912025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84922025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84932025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84942025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84952025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84962025-01-11T05:38:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84972025-01-11T05:38:40.681ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.926118ms iteration = 7 status = {"nsuccess":5}
84982025-01-11T05:38:40.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84992025-01-11T05:38:40.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85002025-01-11T05:38:40.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85012025-01-11T05:38:40.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85022025-01-11T05:38:40.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85032025-01-11T05:38:40.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85042025-01-11T05:38:40.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85052025-01-11T05:38:40.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f55ba25b-688b-46fa-9852-2b5410def120, lookup_type: ById(f55ba25b-688b-46fa-9852-2b5410def120) } result = Ok(())
85062025-01-11T05:38:40.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85072025-01-11T05:38:40.686ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85082025-01-11T05:38:40.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85092025-01-11T05:38:40.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85102025-01-11T05:38:40.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85112025-01-11T05:38:40.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85122025-01-11T05:38:40.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85132025-01-11T05:38:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85142025-01-11T05:38:40.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85152025-01-11T05:38:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85162025-01-11T05:38:40.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85172025-01-11T05:38:40.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85182025-01-11T05:38:40.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85192025-01-11T05:38:40.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85202025-01-11T05:38:40.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85212025-01-11T05:38:40.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85222025-01-11T05:38:40.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85232025-01-11T05:38:40.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85242025-01-11T05:38:40.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85252025-01-11T05:38:40.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85262025-01-11T05:38:40.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
85272025-01-11T05:38:40.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85282025-01-11T05:38:40.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85292025-01-11T05:38:40.707ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.286345ms iteration = 31 status = 0
85302025-01-11T05:38:40.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f55ba25b-688b-46fa-9852-2b5410def120 original_time_created = 2025-01-11 05:23:32.829146 UTC target_id = f55ba25b-688b-46fa-9852-2b5410def120 time_created = 2025-01-11 05:23:32.829146 UTC
85312025-01-11T05:38:40.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.167234ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f55ba25b-688b-46fa-9852-2b5410def120","time_created":"2025-01-11T05:23:32.829146Z"}
85322025-01-11T05:38:40.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
85332025-01-11T05:38:40.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85342025-01-11T05:38:40.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85352025-01-11T05:38:40.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85362025-01-11T05:38:40.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85372025-01-11T05:38:40.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85382025-01-11T05:38:40.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85392025-01-11T05:38:40.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.798546ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85402025-01-11T05:38:40.712ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85412025-01-11T05:38:40.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.093772ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85422025-01-11T05:38:40.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85432025-01-11T05:38:40.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85442025-01-11T05:38:40.714ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85452025-01-11T05:38:40.714ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85462025-01-11T05:38:40.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85472025-01-11T05:38:40.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85482025-01-11T05:38:40.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
85492025-01-11T05:38:40.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85502025-01-11T05:38:40.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85512025-01-11T05:38:40.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.051433ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85522025-01-11T05:38:40.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85532025-01-11T05:38:40.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85542025-01-11T05:38:40.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85552025-01-11T05:38:40.724ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85562025-01-11T05:38:40.724ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.726256ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85572025-01-11T05:38:40.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85582025-01-11T05:38:40.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85592025-01-11T05:38:40.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85602025-01-11T05:38:40.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85612025-01-11T05:38:40.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85622025-01-11T05:38:40.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85632025-01-11T05:38:40.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85642025-01-11T05:38:40.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652025-01-11T05:38:40.729ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85662025-01-11T05:38:40.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85672025-01-11T05:38:40.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85682025-01-11T05:38:40.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85692025-01-11T05:38:40.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85702025-01-11T05:38:40.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85712025-01-11T05:38:40.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85722025-01-11T05:38:40.732ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85732025-01-11T05:38:40.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85742025-01-11T05:38:40.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85752025-01-11T05:38:40.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
85762025-01-11T05:38:40.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85772025-01-11T05:38:40.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85782025-01-11T05:38:40.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85792025-01-11T05:38:40.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85802025-01-11T05:38:40.734ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.813997ms iteration = 34 status = {"physical_disks_added":0}
85812025-01-11T05:38:40.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85822025-01-11T05:38:40.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85832025-01-11T05:38:40.736ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
85842025-01-11T05:38:40.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 134.73733ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
85852025-01-11T05:38:40.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85862025-01-11T05:38:40.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85872025-01-11T05:38:40.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85882025-01-11T05:38:40.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
85892025-01-11T05:38:40.739ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85902025-01-11T05:38:40.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85912025-01-11T05:38:40.740ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29ccf91e-91e6-4bfc-99ef-c798559be3b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
85922025-01-11T05:38:40.740ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
85932025-01-11T05:38:40.740ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-11 05:24:31.341145 UTC dns_group = external generation = 2
85942025-01-11T05:38:40.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.850659ms iteration = 16 status = {"generation":2}
85952025-01-11T05:38:40.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85962025-01-11T05:38:40.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85972025-01-11T05:38:40.742ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85982025-01-11T05:38:40.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85992025-01-11T05:38:40.745ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86002025-01-11T05:38:40.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86012025-01-11T05:38:40.746ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86022025-01-11T05:38:40.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86032025-01-11T05:38:40.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86042025-01-11T05:38:40.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86052025-01-11T05:38:40.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86062025-01-11T05:38:40.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86072025-01-11T05:38:40.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082025-01-11T05:38:40.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.558044ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
86092025-01-11T05:38:40.752ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86102025-01-11T05:38:40.752ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86112025-01-11T05:38:40.752ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.148247ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86122025-01-11T05:38:40.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
86132025-01-11T05:38:40.754ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86142025-01-11T05:38:40.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86152025-01-11T05:38:40.756ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86162025-01-11T05:38:40.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86172025-01-11T05:38:40.761ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86182025-01-11T05:38:40.761ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86192025-01-11T05:38:40.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86202025-01-11T05:38:40.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86212025-01-11T05:38:40.769ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-11T05:23:39.248496Z, time_modified: 2025-01-11T05:23:39.248496Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, db_silo: Silo { identity: SiloIdentity { id: 8546ff28-6c6b-4dfc-933d-04ca6a8f7785, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-11T05:24:31.143904Z, time_modified: 2025-01-11T05:24:31.143904Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b" }] }) }
86222025-01-11T05:38:40.769ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 168.229963ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]}},"default_endpoint":{"silo_id":"8546ff28-6c6b-4dfc-933d-04ca6a8f7785","tls_certs":["d2efdd13c605a40f601d8a51739e1be20dabfc12a14355f728a06ffd71a2255b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
86232025-01-11T05:38:40.784ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
86242025-01-11T05:38:40.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86252025-01-11T05:38:40.841ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86262025-01-11T05:38:40.842ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44621cae-6245-40b8-9192-552172495686", "content-length": "26", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
86272025-01-11T05:38:40.842ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86282025-01-11T05:38:40.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86292025-01-11T05:38:40.881ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86302025-01-11T05:38:40.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86312025-01-11T05:38:40.988ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86322025-01-11T05:38:40.988ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b607fc9c-c25d-4b87-a26f-d537e02bb970", "content-length": "26", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
86332025-01-11T05:38:40.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86342025-01-11T05:38:40.990ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86352025-01-11T05:38:40.994ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86362025-01-11T05:38:40.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86372025-01-11T05:38:40.994ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "49488134-6b8e-400b-9239-c40f64472790", "content-length": "372", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
86382025-01-11T05:38:40.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86392025-01-11T05:38:40.994ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 zone_address = fd00:1122:3344:101::2
86402025-01-11T05:38:40.994ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86412025-01-11T05:38:40.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86422025-01-11T05:38:40.994ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ced937c-32fe-4639-8e5c-9101974da0a0", "content-length": "26", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
86432025-01-11T05:38:40.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86442025-01-11T05:38:40.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
86452025-01-11T05:38:40.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86462025-01-11T05:38:40.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86472025-01-11T05:38:40.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86482025-01-11T05:38:40.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86492025-01-11T05:38:40.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86502025-01-11T05:38:40.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86512025-01-11T05:38:40.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86522025-01-11T05:38:41.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
86532025-01-11T05:38:41.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86542025-01-11T05:38:41.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86552025-01-11T05:38:41.002ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0112f8ef-a9bd-4883-a62e-39243498070b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
86562025-01-11T05:38:41.002ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86572025-01-11T05:38:41.002ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-11 05:24:28.537922 UTC dns_group = internal generation = 1
86582025-01-11T05:38:41.002ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 400.818844ms iteration = 16 status = {"generation":1}
86592025-01-11T05:38:41.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86602025-01-11T05:38:41.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86612025-01-11T05:38:41.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86622025-01-11T05:38:41.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86632025-01-11T05:38:41.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86642025-01-11T05:38:41.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86652025-01-11T05:38:41.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86662025-01-11T05:38:41.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86672025-01-11T05:38:41.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86682025-01-11T05:38:41.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86692025-01-11T05:38:41.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86702025-01-11T05:38:41.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86712025-01-11T05:38:41.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86722025-01-11T05:38:41.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86732025-01-11T05:38:41.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86742025-01-11T05:38:41.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
86752025-01-11T05:38:41.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86762025-01-11T05:38:41.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86772025-01-11T05:38:41.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86782025-01-11T05:38:41.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86792025-01-11T05:38:41.026ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86802025-01-11T05:38:41.026ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c5c1007-cbfb-40ff-b0fd-78aea04b8345", "content-length": "2", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
86812025-01-11T05:38:41.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86822025-01-11T05:38:41.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86832025-01-11T05:38:41.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86842025-01-11T05:38:41.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86852025-01-11T05:38:41.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86862025-01-11T05:38:41.029ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 428.173513ms iteration = 31 status = null
86872025-01-11T05:38:41.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
86882025-01-11T05:38:41.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86892025-01-11T05:38:41.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86902025-01-11T05:38:41.041ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 3da168c4-8069-45d6-a96c-9bd6e5b1cbe0, kind: Service { id: 41bd7929-21b3-4420-bdfb-4d377eca1275 }, name: Name("nexus-41bd7929-21b3-4420-bdfb-4d377eca1275"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a400d6b-d9c4-4d4f-9a93-9d358fd2213c, kind: Service { id: c65b59c5-6763-4b24-9975-b340540b3788 }, name: Name("nexus-c65b59c5-6763-4b24-9975-b340540b3788"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f2934fe9-7f56-4391-9cbd-73ed0873ef74, kind: Service { id: aa9e7449-5e0d-48f2-bc5e-e67a9910d88d }, name: Name("nexus-aa9e7449-5e0d-48f2-bc5e-e67a9910d88d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4d89a779-1fc1-4488-b830-819ec303eab4, kind: Service { id: 4266b46f-6e12-4383-943a-1dff6b37826d }, name: Name("external-dns-4266b46f-6e12-4383-943a-1dff6b37826d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ad212fc-1d4f-4b29-8673-c28d5f4e1980, kind: Service { id: 50be0e3a-9e97-45f3-9749-f7daddfbf5a4 }, name: Name("external-dns-50be0e3a-9e97-45f3-9749-f7daddfbf5a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
86912025-01-11T05:38:41.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86922025-01-11T05:38:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86932025-01-11T05:38:41.042ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86942025-01-11T05:38:41.042ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86952025-01-11T05:38:41.042ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47916a30-61e9-4fb6-804b-05a528a5e66f", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
86962025-01-11T05:38:41.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86972025-01-11T05:38:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86982025-01-11T05:38:41.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86992025-01-11T05:38:41.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87002025-01-11T05:38:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87012025-01-11T05:38:41.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
87022025-01-11T05:38:41.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87032025-01-11T05:38:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87042025-01-11T05:38:41.047ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
87052025-01-11T05:38:41.047ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4d89a779-1fc1-4488-b830-819ec303eab4, kind: Service { id: 4266b46f-6e12-4383-943a-1dff6b37826d }, name: Name("external-dns-4266b46f-6e12-4383-943a-1dff6b37826d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9ad212fc-1d4f-4b29-8673-c28d5f4e1980, kind: Service { id: 50be0e3a-9e97-45f3-9749-f7daddfbf5a4 }, name: Name("external-dns-50be0e3a-9e97-45f3-9749-f7daddfbf5a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3da168c4-8069-45d6-a96c-9bd6e5b1cbe0, kind: Service { id: 41bd7929-21b3-4420-bdfb-4d377eca1275 }, name: Name("nexus-41bd7929-21b3-4420-bdfb-4d377eca1275"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a400d6b-d9c4-4d4f-9a93-9d358fd2213c, kind: Service { id: c65b59c5-6763-4b24-9975-b340540b3788 }, name: Name("nexus-c65b59c5-6763-4b24-9975-b340540b3788"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f2934fe9-7f56-4391-9cbd-73ed0873ef74, kind: Service { id: aa9e7449-5e0d-48f2-bc5e-e67a9910d88d }, name: Name("nexus-aa9e7449-5e0d-48f2-bc5e-e67a9910d88d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
87062025-01-11T05:38:41.047ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
87072025-01-11T05:38:41.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87082025-01-11T05:38:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87092025-01-11T05:38:41.049ZINFOnexus (BackgroundTasks): VPC route manager sled 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87102025-01-11T05:38:41.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87112025-01-11T05:38:41.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cf3d0954-8ab9-4475-9750-9ce1f7d7480e", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87122025-01-11T05:38:41.051ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 449.763396ms iteration = 32 status = {}
87132025-01-11T05:38:41.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87142025-01-11T05:38:41.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87152025-01-11T05:38:41.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "23cbd601-d02b-483e-b421-fb6acea004b2", "content-length": "691", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87162025-01-11T05:38:41.089ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87172025-01-11T05:38:41.089ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87182025-01-11T05:38:41.089ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87192025-01-11T05:38:41.091ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 490.089209ms iteration = 32 status = {}
87202025-01-11T05:38:41.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
87212025-01-11T05:38:41.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "45e235e7-bf84-4d91-93fc-2133dd67e8ea", "date": "Sat, 11 Jan 2025 05:38:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87222025-01-11T05:38:41.093ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87232025-01-11T05:38:41.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6cd473c2-048a-4dc6-a282-9518fe1a0cea", "date": "Sat, 11 Jan 2025 05:38:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87242025-01-11T05:38:41.095ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87252025-01-11T05:38:41.097ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87262025-01-11T05:38:41.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 495.516387ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87272025-01-11T05:38:41.099ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, time_created: 2025-01-11T05:24:26.125273Z, time_modified: 2025-01-11T05:24:26.125273Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
87282025-01-11T05:38:41.099ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
87292025-01-11T05:38:41.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87302025-01-11T05:38:41.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87312025-01-11T05:38:41.102ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87322025-01-11T05:38:41.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87332025-01-11T05:38:41.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87342025-01-11T05:38:41.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd, lookup_type: ById(1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd) } result = Ok(())
87352025-01-11T05:38:41.124ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 522.720163ms iteration = 31 status = {}
87362025-01-11T05:38:41.184ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87372025-01-11T05:38:41.184ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e461e273-b645-4e15-9457-abd015375270", "date": "Sat, 11 Jan 2025 05:38:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87382025-01-11T05:38:41.184ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87392025-01-11T05:38:41.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "15a4fcda-d899-40a1-ae9a-572015f2efff", "date": "Sat, 11 Jan 2025 05:38:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87402025-01-11T05:38:41.185ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87412025-01-11T05:38:41.187ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a40de4ab-d2f4-4cb8-86ad-05f1d523818f", "date": "Sat, 11 Jan 2025 05:38:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87422025-01-11T05:38:41.187ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87432025-01-11T05:38:41.189ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
87442025-01-11T05:38:41.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 587.46955ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
87452025-01-11T05:38:41.197ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
87462025-01-11T05:38:41.198ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "0054faf9-e759-479f-a961-d3d411f1a8c6", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87472025-01-11T05:38:41.198ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
87482025-01-11T05:38:41.198ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 597.04191ms
87492025-01-11T05:38:41.198ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 597.05435ms iteration = 4 status = {}
87502025-01-11T05:38:41.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87512025-01-11T05:38:41.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87522025-01-11T05:38:41.235ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 0b9d037f-ee79-414a-94d8-672e23c4ebd7, rack_id: 41cc6a35-6e91-4970-a710-a6745ca10ae3, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(9445027d-0b3b-4f5a-973f-0591895b3904) } rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
87532025-01-11T05:38:41.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87542025-01-11T05:38:41.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87552025-01-11T05:38:41.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87562025-01-11T05:38:41.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6665916-8dcc-484e-8c3e-a1372f1f58c6", "content-length": "134", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87572025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87582025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 9445027d-0b3b-4f5a-973f-0591895b3904
87592025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87602025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87612025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87622025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87632025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87642025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87652025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87662025-01-11T05:38:41.245ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87672025-01-11T05:38:41.246ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3
87682025-01-11T05:38:41.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87692025-01-11T05:38:41.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87702025-01-11T05:38:41.247ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87712025-01-11T05:38:41.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7b16e8b-841f-43a1-b4da-330c87bfe455", "content-length": "2", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87722025-01-11T05:38:41.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87732025-01-11T05:38:41.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f9342ae-a9b2-4fc6-8c43-c5280fa08e90", "content-length": "52", "date": "Sat, 11 Jan 2025 05:38:41 GMT"} })
87742025-01-11T05:38:41.248ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch_location = Switch0
87752025-01-11T05:38:41.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87762025-01-11T05:38:41.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7c8c9bc-790e-4409-a29d-7a013cb24f7f", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87772025-01-11T05:38:41.346ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 switch = Switch0
87782025-01-11T05:38:41.346ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87792025-01-11T05:38:41.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 41cc6a35-6e91-4970-a710-a6745ca10ae3 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a86dc61b-0bc0-4e71-af71-9a2716bcb93e", "content-length": "682", "date": "Sat, 11 Jan 2025 05:38:40 GMT"} })
87802025-01-11T05:38:41.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87812025-01-11T05:38:41.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87822025-01-11T05:38:41.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87832025-01-11T05:38:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87842025-01-11T05:38:41.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87852025-01-11T05:38:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87862025-01-11T05:38:41.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87872025-01-11T05:38:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87882025-01-11T05:38:41.363ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 761.746804ms iteration = 31 status = {}
87892025-01-11T05:38:41.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdb440d1-7a2d-4475-98e7-d3395ff77e21 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87902025-01-11T05:38:41.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdb440d1-7a2d-4475-98e7-d3395ff77e21 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87912025-01-11T05:38:41.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = fdb440d1-7a2d-4475-98e7-d3395ff77e21 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87922025-01-11T05:38:42.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 487bf6c3-c379-43b1-93bb-d3f749252cca roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87932025-01-11T05:38:42.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 487bf6c3-c379-43b1-93bb-d3f749252cca resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87942025-01-11T05:38:42.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 487bf6c3-c379-43b1-93bb-d3f749252cca response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87952025-01-11T05:38:43.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3ba9a491-4499-47e9-8161-8c18fc11a775 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87962025-01-11T05:38:43.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3ba9a491-4499-47e9-8161-8c18fc11a775 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87972025-01-11T05:38:43.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 3ba9a491-4499-47e9-8161-8c18fc11a775 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
87982025-01-11T05:38:43.783ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:53338 method = GET remote_addr = [fd00:1122:3344:101::d]:53669 req_id = 7fcb9898-b05c-4d4d-b075-22cb67ba812d response_code = 200 uri = /aa9e7449-5e0d-48f2-bc5e-e67a9910d88d
87992025-01-11T05:38:44.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1c4a31a4-c86b-47a3-a114-8bc9115db531 roles = RoleSet { roles: {} } uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
88002025-01-11T05:38:44.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1c4a31a4-c86b-47a3-a114-8bc9115db531 resource = Database result = Ok(()) uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd
88012025-01-11T05:38:44.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45224 req_id = 1c4a31a4-c86b-47a3-a114-8bc9115db531 response_code = 200 uri = /probes/1148eb3f-a5ca-44e2-b9ed-d6dd78fa1fdd