Max level shown:
12025-07-01T00:15:02.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45458f4c-0999-4a44-8e1e-ba4b2fc03357 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22025-07-01T00:15:02.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45458f4c-0999-4a44-8e1e-ba4b2fc03357 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32025-07-01T00:15:02.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2711 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45458f4c-0999-4a44-8e1e-ba4b2fc03357 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42025-07-01T00:15:03.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 05192ac3-54bb-4896-bb94-0376c721c812 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52025-07-01T00:15:03.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 05192ac3-54bb-4896-bb94-0376c721c812 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62025-07-01T00:15:03.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 05192ac3-54bb-4896-bb94-0376c721c812 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72025-07-01T00:15:03.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
82025-07-01T00:15:03.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92025-07-01T00:15:03.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
102025-07-01T00:15:03.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112025-07-01T00:15:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122025-07-01T00:15:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132025-07-01T00:15:03.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142025-07-01T00:15:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
152025-07-01T00:15:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
162025-07-01T00:15:03.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.865685ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
172025-07-01T00:15:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
182025-07-01T00:15:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
192025-07-01T00:15:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
202025-07-01T00:15:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
212025-07-01T00:15:03.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
222025-07-01T00:15:03.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
232025-07-01T00:15:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
242025-07-01T00:15:03.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252025-07-01T00:15:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
262025-07-01T00:15:03.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
272025-07-01T00:15:03.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.756335ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
282025-07-01T00:15:04.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 686f318c-a6f1-4ade-b41e-9c0097fdb462 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
292025-07-01T00:15:04.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 686f318c-a6f1-4ade-b41e-9c0097fdb462 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
302025-07-01T00:15:04.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 686f318c-a6f1-4ade-b41e-9c0097fdb462 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
312025-07-01T00:15:04.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = d7a399d4-c915-47f2-9168-bae35b2e4a9b response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
322025-07-01T00:15:05.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45b5d576-b765-47da-a3fd-a374c4944034 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
332025-07-01T00:15:05.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45b5d576-b765-47da-a3fd-a374c4944034 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
342025-07-01T00:15:05.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45b5d576-b765-47da-a3fd-a374c4944034 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
352025-07-01T00:15:06.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4393ee7c-82fc-4c8b-a9f1-533fd20a3f96 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
362025-07-01T00:15:06.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4393ee7c-82fc-4c8b-a9f1-533fd20a3f96 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
372025-07-01T00:15:06.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4393ee7c-82fc-4c8b-a9f1-533fd20a3f96 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
382025-07-01T00:15:07.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f2caadf-8972-4661-a55d-d95c8d11394f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
392025-07-01T00:15:07.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f2caadf-8972-4661-a55d-d95c8d11394f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
402025-07-01T00:15:07.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f2caadf-8972-4661-a55d-d95c8d11394f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
412025-07-01T00:15:08.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9d2808f9-4655-4d5c-8213-8dd6ade3e5c2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
422025-07-01T00:15:08.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9d2808f9-4655-4d5c-8213-8dd6ade3e5c2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
432025-07-01T00:15:08.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9d2808f9-4655-4d5c-8213-8dd6ade3e5c2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
442025-07-01T00:15:09.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 332cdb11-87b4-4b5c-bce7-742461131814 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
452025-07-01T00:15:09.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 332cdb11-87b4-4b5c-bce7-742461131814 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
462025-07-01T00:15:09.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 332cdb11-87b4-4b5c-bce7-742461131814 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
472025-07-01T00:15:10.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e77551f4-b278-4235-92fc-3fc4d87797b3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
482025-07-01T00:15:10.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e77551f4-b278-4235-92fc-3fc4d87797b3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
492025-07-01T00:15:10.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e77551f4-b278-4235-92fc-3fc4d87797b3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
502025-07-01T00:15:11.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0e88c651-b639-4217-be37-1a427076438e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
512025-07-01T00:15:11.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0e88c651-b639-4217-be37-1a427076438e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
522025-07-01T00:15:11.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0e88c651-b639-4217-be37-1a427076438e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
532025-07-01T00:15:12.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a2ec9e38-9f07-4964-8b6e-fb0e6f1c88c9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
542025-07-01T00:15:12.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a2ec9e38-9f07-4964-8b6e-fb0e6f1c88c9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
552025-07-01T00:15:12.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a2ec9e38-9f07-4964-8b6e-fb0e6f1c88c9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
562025-07-01T00:15:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
572025-07-01T00:15:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
582025-07-01T00:15:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
592025-07-01T00:15:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
602025-07-01T00:15:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
612025-07-01T00:15:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
622025-07-01T00:15:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
632025-07-01T00:15:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
642025-07-01T00:15:13.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
652025-07-01T00:15:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.952078ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
662025-07-01T00:15:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
672025-07-01T00:15:13.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
682025-07-01T00:15:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
692025-07-01T00:15:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
702025-07-01T00:15:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
712025-07-01T00:15:13.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
722025-07-01T00:15:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
732025-07-01T00:15:13.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
742025-07-01T00:15:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
752025-07-01T00:15:13.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
762025-07-01T00:15:13.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.091254ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
772025-07-01T00:15:13.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 336e3c91-49d9-47fa-80c3-0f643d634592 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
782025-07-01T00:15:13.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 336e3c91-49d9-47fa-80c3-0f643d634592 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
792025-07-01T00:15:13.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 336e3c91-49d9-47fa-80c3-0f643d634592 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
802025-07-01T00:15:14.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 713 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 226a0bb5-9d1f-4525-8497-0a5557b33569 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
812025-07-01T00:15:14.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55a50947-e82f-4cfd-aab4-cb7ebd5e5024 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
822025-07-01T00:15:14.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55a50947-e82f-4cfd-aab4-cb7ebd5e5024 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
832025-07-01T00:15:14.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55a50947-e82f-4cfd-aab4-cb7ebd5e5024 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
842025-07-01T00:15:16.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 75fd7834-ed51-4217-9c58-402f28f5e13f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
852025-07-01T00:15:16.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 75fd7834-ed51-4217-9c58-402f28f5e13f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
862025-07-01T00:15:16.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 75fd7834-ed51-4217-9c58-402f28f5e13f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
872025-07-01T00:15:17.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eccdb73f-78d4-41dd-8397-c24ee13d3321 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
882025-07-01T00:15:17.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eccdb73f-78d4-41dd-8397-c24ee13d3321 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
892025-07-01T00:15:17.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eccdb73f-78d4-41dd-8397-c24ee13d3321 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
902025-07-01T00:15:18.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0822f2f-7f41-4ec3-ac9f-69693a9b95cf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
912025-07-01T00:15:18.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0822f2f-7f41-4ec3-ac9f-69693a9b95cf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
922025-07-01T00:15:18.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1896 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0822f2f-7f41-4ec3-ac9f-69693a9b95cf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
932025-07-01T00:15:19.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 916701c1-5745-4ef9-9d7b-012ce9a285aa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
942025-07-01T00:15:19.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 916701c1-5745-4ef9-9d7b-012ce9a285aa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
952025-07-01T00:15:19.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 916701c1-5745-4ef9-9d7b-012ce9a285aa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
962025-07-01T00:15:20.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6ef979a6-7249-4ab0-9f5d-76e4d7866ecb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
972025-07-01T00:15:20.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6ef979a6-7249-4ab0-9f5d-76e4d7866ecb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
982025-07-01T00:15:20.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6ef979a6-7249-4ab0-9f5d-76e4d7866ecb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
992025-07-01T00:15:21.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cabbbb81-0e0a-4333-b75f-1729522983a0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1002025-07-01T00:15:21.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cabbbb81-0e0a-4333-b75f-1729522983a0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1012025-07-01T00:15:21.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cabbbb81-0e0a-4333-b75f-1729522983a0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1022025-07-01T00:15:22.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 42c82b03-125b-4f2e-8db8-4517d6f49346 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1032025-07-01T00:15:22.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 42c82b03-125b-4f2e-8db8-4517d6f49346 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1042025-07-01T00:15:22.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 42c82b03-125b-4f2e-8db8-4517d6f49346 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1052025-07-01T00:15:23.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31533eda-208e-4bc3-8b5a-e5f416aeedbd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1062025-07-01T00:15:23.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31533eda-208e-4bc3-8b5a-e5f416aeedbd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1072025-07-01T00:15:23.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31533eda-208e-4bc3-8b5a-e5f416aeedbd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
1082025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
1092025-07-01T00:15:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
1102025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.381\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
1112025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
1122025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
1132025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1142025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
1152025-07-01T00:15:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:05:23.901653255 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1162025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
1172025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1182025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
1192025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
1202025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1212025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1222025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
1232025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1242025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1252025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
1262025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1272025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
1282025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
1292025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
1302025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1312025-07-01T00:15:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1322025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1332025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1342025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1352025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1362025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1372025-07-01T00:15:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1253, tv_nsec: 727749707 } })
1382025-07-01T00:15:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1253, tv_nsec: 727809198 } })
1392025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 8 reason = Timeout
1402025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
1412025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
1422025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 13.111\u{b5}s iteration = 8 status = "Disabled"
1432025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
1442025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
1452025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1462025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1472025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
1482025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1492025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1502025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1512025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
1522025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1532025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
1542025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1552025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
1562025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1572025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.068729ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1582025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
1592025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1602025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
1612025-07-01T00:15:23.902ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
1622025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1632025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1642025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
1652025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1662025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
1672025-07-01T00:15:23.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1682025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
1692025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1702025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
1712025-07-01T00:15:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1722025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1732025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
1742025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1752025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1762025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
1772025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.388578ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
1782025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1792025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1802025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1812025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1822025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1832025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1842025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1852025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1862025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1872025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1882025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1892025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1902025-07-01T00:15:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1912025-07-01T00:15:23.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1922025-07-01T00:15:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1932025-07-01T00:15:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1942025-07-01T00:15:23.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1253, tv_nsec: 730230455 } })
1952025-07-01T00:15:23.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
1962025-07-01T00:15:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.622449ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1972025-07-01T00:15:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1982025-07-01T00:15:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1992025-07-01T00:15:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1253, tv_nsec: 731659514 } })
2002025-07-01T00:15:23.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2012025-07-01T00:15:23.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2022025-07-01T00:15:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2032025-07-01T00:15:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
2042025-07-01T00:15:23.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052025-07-01T00:15:23.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:05:23.901653255 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2062025-07-01T00:15:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.204553ms iteration = 5 status = {"expiration":"2025-07-01T00:05:23.901653255Z","pruned":[]}
2072025-07-01T00:15:23.908ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2082025-07-01T00:15:23.908ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2092025-07-01T00:15:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2102025-07-01T00:15:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2112025-07-01T00:15:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2122025-07-01T00:15:23.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132025-07-01T00:15:23.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2142025-07-01T00:15:23.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152025-07-01T00:15:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2162025-07-01T00:15:23.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2172025-07-01T00:15:23.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2182025-07-01T00:15:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2192025-07-01T00:15:23.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202025-07-01T00:15:23.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2212025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
2222025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2232025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
2242025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2252025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
2262025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2272025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
2282025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
2292025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 9 reason = Timeout
2302025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
2312025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2322025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 5 reason = Timeout
2332025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
2342025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
2352025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
2362025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 5 reason = Timeout
2382025-07-01T00:15:23.912ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
2392025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2402025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2412025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2422025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2432025-07-01T00:15:23.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1253, tv_nsec: 738622954 } })
2442025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2452025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2462025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
2472025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
2482025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2502025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
2512025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2522025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2532025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2542025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2552025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2562025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2572025-07-01T00:15:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2582025-07-01T00:15:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592025-07-01T00:15:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2602025-07-01T00:15:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2612025-07-01T00:15:23.914ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2622025-07-01T00:15:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2632025-07-01T00:15:23.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2642025-07-01T00:15:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2652025-07-01T00:15:23.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2662025-07-01T00:15:23.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2672025-07-01T00:15:23.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2682025-07-01T00:15:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2692025-07-01T00:15:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2702025-07-01T00:15:23.916ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.238486ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
2712025-07-01T00:15:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2722025-07-01T00:15:23.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2732025-07-01T00:15:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2742025-07-01T00:15:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2752025-07-01T00:15:23.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2762025-07-01T00:15:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2772025-07-01T00:15:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2782025-07-01T00:15:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2792025-07-01T00:15:23.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2802025-07-01T00:15:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2812025-07-01T00:15:23.926ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2822025-07-01T00:15:23.926ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1253, tv_nsec: 751971349 } })
2832025-07-01T00:15:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2842025-07-01T00:15:23.926ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
2852025-07-01T00:15:23.926ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 14.133447ms iteration = 5 status = {"by_rx":{},"error":null}
2862025-07-01T00:15:23.926ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
2872025-07-01T00:15:23.929ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2882025-07-01T00:15:23.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.350141ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2892025-07-01T00:15:23.931ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
2902025-07-01T00:15:23.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
2912025-07-01T00:15:23.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2922025-07-01T00:15:23.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2932025-07-01T00:15:23.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2942025-07-01T00:15:23.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2952025-07-01T00:15:23.933ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2962025-07-01T00:15:23.935ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 22.859285ms iteration = 5 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
2972025-07-01T00:15:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2982025-07-01T00:15:23.936ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2992025-07-01T00:15:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3002025-07-01T00:15:23.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3012025-07-01T00:15:23.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3022025-07-01T00:15:23.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3032025-07-01T00:15:23.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3042025-07-01T00:15:23.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3052025-07-01T00:15:23.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
3062025-07-01T00:15:23.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3072025-07-01T00:15:23.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3082025-07-01T00:15:23.962ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3092025-07-01T00:15:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3102025-07-01T00:15:23.970ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 57.537955ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
3112025-07-01T00:15:23.971ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3122025-07-01T00:15:23.971ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3132025-07-01T00:15:23.971ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3142025-07-01T00:15:23.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3152025-07-01T00:15:23.972ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3162025-07-01T00:15:23.972ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3172025-07-01T00:15:23.972ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3182025-07-01T00:15:23.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3192025-07-01T00:15:23.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3202025-07-01T00:15:23.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.334304ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3212025-07-01T00:15:23.974ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3222025-07-01T00:15:23.974ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3232025-07-01T00:15:23.974ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3242025-07-01T00:15:23.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3252025-07-01T00:15:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3262025-07-01T00:15:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.512937ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
3272025-07-01T00:15:23.976ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3282025-07-01T00:15:23.976ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3292025-07-01T00:15:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.576423ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3302025-07-01T00:15:23.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3312025-07-01T00:15:23.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3322025-07-01T00:15:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3332025-07-01T00:15:23.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3342025-07-01T00:15:23.979ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3352025-07-01T00:15:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3362025-07-01T00:15:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3372025-07-01T00:15:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3382025-07-01T00:15:23.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3392025-07-01T00:15:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3402025-07-01T00:15:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 69.162472ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3412025-07-01T00:15:23.984ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422025-07-01T00:15:23.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3432025-07-01T00:15:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3442025-07-01T00:15:23.985ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3452025-07-01T00:15:23.985ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
3462025-07-01T00:15:23.985ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.683652ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3472025-07-01T00:15:23.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.249754ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
3482025-07-01T00:15:23.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.689466ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3492025-07-01T00:15:23.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502025-07-01T00:15:23.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512025-07-01T00:15:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3522025-07-01T00:15:23.989ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3532025-07-01T00:15:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3542025-07-01T00:15:23.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3552025-07-01T00:15:23.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3562025-07-01T00:15:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3572025-07-01T00:15:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
3582025-07-01T00:15:23.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3592025-07-01T00:15:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3602025-07-01T00:15:23.993ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
3612025-07-01T00:15:23.993ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.162704ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
3622025-07-01T00:15:23.996ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.473907ms iteration = 9 status = 0
3632025-07-01T00:15:23.998ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
3642025-07-01T00:15:23.998ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 95.74367ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
3652025-07-01T00:15:24.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3662025-07-01T00:15:24.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.573567ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3672025-07-01T00:15:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3682025-07-01T00:15:24.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3692025-07-01T00:15:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3702025-07-01T00:15:24.026ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3712025-07-01T00:15:24.026ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
3722025-07-01T00:15:24.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3732025-07-01T00:15:24.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3742025-07-01T00:15:24.027ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3752025-07-01T00:15:24.027ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3762025-07-01T00:15:24.027ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.398334ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3772025-07-01T00:15:24.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3782025-07-01T00:15:24.030ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3792025-07-01T00:15:24.030ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3802025-07-01T00:15:24.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3812025-07-01T00:15:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3822025-07-01T00:15:24.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3832025-07-01T00:15:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3842025-07-01T00:15:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3852025-07-01T00:15:24.033ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
3862025-07-01T00:15:24.033ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3872025-07-01T00:15:24.033ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
3882025-07-01T00:15:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 131.449146ms iteration = 5 status = {"generation":2}
3892025-07-01T00:15:24.033ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3902025-07-01T00:15:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3912025-07-01T00:15:24.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3922025-07-01T00:15:24.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3932025-07-01T00:15:24.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3942025-07-01T00:15:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3952025-07-01T00:15:24.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3962025-07-01T00:15:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3972025-07-01T00:15:24.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3982025-07-01T00:15:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3992025-07-01T00:15:24.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4002025-07-01T00:15:24.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4012025-07-01T00:15:24.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4022025-07-01T00:15:24.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4032025-07-01T00:15:24.076ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
4042025-07-01T00:15:24.076ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4052025-07-01T00:15:24.076ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
4062025-07-01T00:15:24.076ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 174.804933ms iteration = 5 status = {"generation":1}
4072025-07-01T00:15:24.091ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.632651ms iteration = 11 status = {"physical_disks_added":0}
4082025-07-01T00:15:24.094ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
4092025-07-01T00:15:24.094ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.642091ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4102025-07-01T00:15:24.094ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
4112025-07-01T00:15:24.094ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4122025-07-01T00:15:24.094ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b90d090-714e-43d4-ad9f-1872d2f75772", "content-length": "26", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4132025-07-01T00:15:24.094ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4142025-07-01T00:15:24.096ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4152025-07-01T00:15:24.099ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
4162025-07-01T00:15:24.099ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e1157eb-43d2-469a-b076-70abf9c33816", "content-length": "78", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4172025-07-01T00:15:24.099ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
4182025-07-01T00:15:24.099ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
4192025-07-01T00:15:24.099ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
4202025-07-01T00:15:24.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
4212025-07-01T00:15:24.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
4222025-07-01T00:15:24.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
4232025-07-01T00:15:24.101ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
4242025-07-01T00:15:24.101ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
4252025-07-01T00:15:24.102ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
4262025-07-01T00:15:24.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
4272025-07-01T00:15:24.104ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
4282025-07-01T00:15:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
4292025-07-01T00:15:24.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
4302025-07-01T00:15:24.104ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
4312025-07-01T00:15:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
4322025-07-01T00:15:24.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
4332025-07-01T00:15:24.105ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
4342025-07-01T00:15:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
4352025-07-01T00:15:24.106ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
4362025-07-01T00:15:24.106ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
4372025-07-01T00:15:24.106ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd00d249-9309-4605-a08a-7c5e84a7c405", "content-length": "81", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4382025-07-01T00:15:24.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 70bcea61-7be2-4a53-afa0-bbe32e2e3acb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
4392025-07-01T00:15:24.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 70bcea61-7be2-4a53-afa0-bbe32e2e3acb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
4402025-07-01T00:15:24.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3400 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 70bcea61-7be2-4a53-afa0-bbe32e2e3acb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
4412025-07-01T00:15:24.165ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
4422025-07-01T00:15:24.165ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
4432025-07-01T00:15:24.166ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "3409123f-b111-4bd2-bf6e-9f084b047da7", "content-length": "81", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4442025-07-01T00:15:24.177ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
4452025-07-01T00:15:24.177ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
4462025-07-01T00:15:24.177ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e6e503c-04a1-4382-b084-4fa436c9b953", "content-length": "81", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4472025-07-01T00:15:24.183ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 270.652296ms iteration = 9 status = {"errors":[],"sps":[]}
4482025-07-01T00:15:24.191ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4492025-07-01T00:15:24.209ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
4502025-07-01T00:15:24.209ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 306.948618ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4512025-07-01T00:15:24.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4522025-07-01T00:15:24.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4532025-07-01T00:15:24.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4542025-07-01T00:15:24.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4552025-07-01T00:15:24.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4562025-07-01T00:15:24.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4572025-07-01T00:15:24.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4582025-07-01T00:15:24.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4592025-07-01T00:15:24.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4602025-07-01T00:15:24.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4612025-07-01T00:15:24.241ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4622025-07-01T00:15:24.249ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4632025-07-01T00:15:24.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4642025-07-01T00:15:24.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6657c201-1dda-4813-908d-dffeca7be8b6", "content-length": "372", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4652025-07-01T00:15:24.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4662025-07-01T00:15:24.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4672025-07-01T00:15:24.264ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4682025-07-01T00:15:24.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4692025-07-01T00:15:24.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b3af231f-278c-43bf-a8de-8411d5ee73ff", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4702025-07-01T00:15:24.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4712025-07-01T00:15:24.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4722025-07-01T00:15:24.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
4732025-07-01T00:15:24.267ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4742025-07-01T00:15:24.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4752025-07-01T00:15:24.268ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2051282-a03b-4e52-a5f2-8878891665ec", "content-length": "26", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4762025-07-01T00:15:24.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4772025-07-01T00:15:24.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4782025-07-01T00:15:24.270ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
4792025-07-01T00:15:24.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4802025-07-01T00:15:24.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4812025-07-01T00:15:24.273ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
4822025-07-01T00:15:24.273ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4832025-07-01T00:15:24.273ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41705a74-d252-4602-889d-074b68f4982b", "content-length": "26", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4842025-07-01T00:15:24.273ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4852025-07-01T00:15:24.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4862025-07-01T00:15:24.278ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4872025-07-01T00:15:24.278ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4882025-07-01T00:15:24.278ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af203c34-f561-465c-a11a-7a8850064e9a", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
4892025-07-01T00:15:24.280ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 377.643402ms iteration = 9 status = {}
4902025-07-01T00:15:24.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4912025-07-01T00:15:24.427ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 526.00804ms iteration = 9 status = {}
4922025-07-01T00:15:24.538ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4932025-07-01T00:15:24.538ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "85f46111-9b96-4237-9dfd-6d0a888650fa", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4942025-07-01T00:15:24.538ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4952025-07-01T00:15:24.540ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c87eebea-d822-437c-bca8-4f5ae87da026", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4962025-07-01T00:15:24.540ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4972025-07-01T00:15:24.543ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4982025-07-01T00:15:24.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 641.46933ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4992025-07-01T00:15:24.545ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5002025-07-01T00:15:24.546ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e063f15e-5739-44b0-8578-b5b7d6ae971f", "content-length": "691", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
5012025-07-01T00:15:24.546ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
5022025-07-01T00:15:24.546ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
5032025-07-01T00:15:24.546ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
5042025-07-01T00:15:24.549ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 646.393935ms iteration = 9 status = {}
5052025-07-01T00:15:24.560ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
5062025-07-01T00:15:24.560ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7228174f-09e7-4781-86e0-a905d2292612", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5072025-07-01T00:15:24.560ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5082025-07-01T00:15:24.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5092025-07-01T00:15:24.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5102025-07-01T00:15:24.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c558a16b-bc91-43bb-be0b-ebbeab73df1f", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5112025-07-01T00:15:24.562ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5122025-07-01T00:15:24.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4f7c59bd-ce32-4ffb-a1bd-a5e9a0deb893", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5132025-07-01T00:15:24.564ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5142025-07-01T00:15:24.564ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 662.869226ms iteration = 9 status = null
5152025-07-01T00:15:24.566ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
5162025-07-01T00:15:24.566ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 664.357556ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
5172025-07-01T00:15:24.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5182025-07-01T00:15:24.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5192025-07-01T00:15:24.625ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
5202025-07-01T00:15:24.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5212025-07-01T00:15:24.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5222025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
5232025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
5242025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5252025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5262025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5272025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5282025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5292025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5302025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5312025-07-01T00:15:24.638ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5322025-07-01T00:15:24.639ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
5332025-07-01T00:15:24.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5342025-07-01T00:15:24.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5352025-07-01T00:15:24.641ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
5362025-07-01T00:15:24.641ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5372025-07-01T00:15:24.738ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "afd7df29-a129-492f-ab8c-b4fc546c6794", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
5382025-07-01T00:15:24.738ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
5392025-07-01T00:15:24.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5402025-07-01T00:15:24.744ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "adcc5acc-3254-49be-8970-da61f00807ff", "content-length": "682", "date": "Tue, 01 Jul 2025 00:15:24 GMT"} })
5412025-07-01T00:15:24.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5422025-07-01T00:15:24.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5432025-07-01T00:15:24.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5442025-07-01T00:15:24.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5452025-07-01T00:15:24.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5462025-07-01T00:15:24.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5472025-07-01T00:15:24.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5482025-07-01T00:15:24.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5492025-07-01T00:15:24.761ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 858.59829ms iteration = 9 status = {}
5502025-07-01T00:15:24.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 11e4159a-b76a-48ee-89fd-1dde4fe988cb response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
5512025-07-01T00:15:25.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f96dbc5b-ff67-46ec-bcde-61deda1127fc roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5522025-07-01T00:15:25.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f96dbc5b-ff67-46ec-bcde-61deda1127fc resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5532025-07-01T00:15:25.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1665 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f96dbc5b-ff67-46ec-bcde-61deda1127fc response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5542025-07-01T00:15:26.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01af0cf4-204f-4eff-9f1f-47036f4fd657 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5552025-07-01T00:15:26.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01af0cf4-204f-4eff-9f1f-47036f4fd657 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5562025-07-01T00:15:26.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2562 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01af0cf4-204f-4eff-9f1f-47036f4fd657 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5572025-07-01T00:15:27.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4cc5a335-1248-4db5-98ae-1b01a09c5c17 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5582025-07-01T00:15:27.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4cc5a335-1248-4db5-98ae-1b01a09c5c17 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5592025-07-01T00:15:27.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4cc5a335-1248-4db5-98ae-1b01a09c5c17 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5602025-07-01T00:15:28.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5a1620fd-e73e-4861-8434-0ca6e8293c7b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5612025-07-01T00:15:28.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5a1620fd-e73e-4861-8434-0ca6e8293c7b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5622025-07-01T00:15:28.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5a1620fd-e73e-4861-8434-0ca6e8293c7b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5632025-07-01T00:15:29.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = df782e12-af8d-4a54-84fb-6ae3fac45c75 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5642025-07-01T00:15:29.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = df782e12-af8d-4a54-84fb-6ae3fac45c75 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5652025-07-01T00:15:29.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2994 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = df782e12-af8d-4a54-84fb-6ae3fac45c75 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5662025-07-01T00:15:30.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 87855f9e-09fe-4e2a-a7aa-da8e6d17a395 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5672025-07-01T00:15:30.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 87855f9e-09fe-4e2a-a7aa-da8e6d17a395 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5682025-07-01T00:15:30.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 87855f9e-09fe-4e2a-a7aa-da8e6d17a395 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5692025-07-01T00:15:31.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 65dd18e3-d4cf-4a2e-be47-12cd84df1d35 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5702025-07-01T00:15:31.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 65dd18e3-d4cf-4a2e-be47-12cd84df1d35 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5712025-07-01T00:15:31.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 65dd18e3-d4cf-4a2e-be47-12cd84df1d35 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5722025-07-01T00:15:32.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0817f251-eaee-4141-97bd-9f907e6c8d6d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5732025-07-01T00:15:32.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0817f251-eaee-4141-97bd-9f907e6c8d6d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5742025-07-01T00:15:32.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0817f251-eaee-4141-97bd-9f907e6c8d6d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5752025-07-01T00:15:33.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 87c10882-dc24-40a3-b958-98924774e7fa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5762025-07-01T00:15:33.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 87c10882-dc24-40a3-b958-98924774e7fa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5772025-07-01T00:15:33.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 87c10882-dc24-40a3-b958-98924774e7fa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
5782025-07-01T00:15:33.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
5792025-07-01T00:15:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
5802025-07-01T00:15:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5812025-07-01T00:15:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5822025-07-01T00:15:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5832025-07-01T00:15:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5842025-07-01T00:15:33.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5852025-07-01T00:15:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862025-07-01T00:15:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5872025-07-01T00:15:33.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.896447ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5882025-07-01T00:15:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5892025-07-01T00:15:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5902025-07-01T00:15:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5912025-07-01T00:15:33.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5922025-07-01T00:15:33.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5932025-07-01T00:15:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942025-07-01T00:15:33.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
5952025-07-01T00:15:33.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5962025-07-01T00:15:33.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5972025-07-01T00:15:33.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
5982025-07-01T00:15:33.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.951551ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
5992025-07-01T00:15:34.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c67b95fb-d2cc-4c0e-89e8-3e780d2a4bec roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6002025-07-01T00:15:34.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c67b95fb-d2cc-4c0e-89e8-3e780d2a4bec resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6012025-07-01T00:15:34.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c67b95fb-d2cc-4c0e-89e8-3e780d2a4bec response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6022025-07-01T00:15:34.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 570 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = aacd7585-5b21-4cc4-9ad6-9d3603921847 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
6032025-07-01T00:15:35.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc570c98-8e90-4629-8c89-624b0fe6c1a2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6042025-07-01T00:15:35.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc570c98-8e90-4629-8c89-624b0fe6c1a2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6052025-07-01T00:15:35.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc570c98-8e90-4629-8c89-624b0fe6c1a2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6062025-07-01T00:15:36.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6c9d22eb-c72a-4261-92c3-1ad5d72979f3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6072025-07-01T00:15:36.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6c9d22eb-c72a-4261-92c3-1ad5d72979f3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6082025-07-01T00:15:36.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6c9d22eb-c72a-4261-92c3-1ad5d72979f3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6092025-07-01T00:15:37.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 66beed8a-f6d7-427f-bb5b-cae929bc5555 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6102025-07-01T00:15:37.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 66beed8a-f6d7-427f-bb5b-cae929bc5555 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6112025-07-01T00:15:37.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 66beed8a-f6d7-427f-bb5b-cae929bc5555 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6122025-07-01T00:15:38.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5f3d56ae-7693-4ca4-b5bd-f5bfdfed697d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6132025-07-01T00:15:38.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5f3d56ae-7693-4ca4-b5bd-f5bfdfed697d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6142025-07-01T00:15:38.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5f3d56ae-7693-4ca4-b5bd-f5bfdfed697d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6152025-07-01T00:15:39.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b1d4497-ea41-40e5-87a1-b6629b6a36f4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6162025-07-01T00:15:39.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b1d4497-ea41-40e5-87a1-b6629b6a36f4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6172025-07-01T00:15:39.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b1d4497-ea41-40e5-87a1-b6629b6a36f4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6182025-07-01T00:15:40.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dd504d12-4737-4157-b2c8-37cc2e573143 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6192025-07-01T00:15:40.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dd504d12-4737-4157-b2c8-37cc2e573143 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6202025-07-01T00:15:40.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dd504d12-4737-4157-b2c8-37cc2e573143 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6212025-07-01T00:15:41.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 19664458-f35c-496c-8143-fc6bc48b9149 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6222025-07-01T00:15:41.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 19664458-f35c-496c-8143-fc6bc48b9149 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6232025-07-01T00:15:41.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 19664458-f35c-496c-8143-fc6bc48b9149 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6242025-07-01T00:15:42.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eae7d07e-63ec-4b9d-8445-43ea7d862271 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6252025-07-01T00:15:42.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eae7d07e-63ec-4b9d-8445-43ea7d862271 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6262025-07-01T00:15:42.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eae7d07e-63ec-4b9d-8445-43ea7d862271 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6272025-07-01T00:15:43.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25ba2820-2059-43a2-9cb2-0c5a52279d48 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6282025-07-01T00:15:43.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25ba2820-2059-43a2-9cb2-0c5a52279d48 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6292025-07-01T00:15:43.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25ba2820-2059-43a2-9cb2-0c5a52279d48 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6302025-07-01T00:15:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
6312025-07-01T00:15:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
6322025-07-01T00:15:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6332025-07-01T00:15:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6342025-07-01T00:15:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6352025-07-01T00:15:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6362025-07-01T00:15:43.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6372025-07-01T00:15:43.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6382025-07-01T00:15:43.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6392025-07-01T00:15:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.996119ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6402025-07-01T00:15:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6412025-07-01T00:15:43.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6422025-07-01T00:15:43.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6432025-07-01T00:15:43.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6442025-07-01T00:15:43.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6452025-07-01T00:15:43.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462025-07-01T00:15:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
6472025-07-01T00:15:43.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6482025-07-01T00:15:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6492025-07-01T00:15:43.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
6502025-07-01T00:15:43.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.614582ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
6512025-07-01T00:15:44.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d8324d1e-7fb1-44b5-b3af-f05eff7956ce roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6522025-07-01T00:15:44.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d8324d1e-7fb1-44b5-b3af-f05eff7956ce resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6532025-07-01T00:15:44.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d8324d1e-7fb1-44b5-b3af-f05eff7956ce response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6542025-07-01T00:15:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 537 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 77bf679d-e729-44c9-bbd6-10792ea4a6aa response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
6552025-07-01T00:15:45.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = afffa0c7-cc65-4606-bdee-213fdc2041a1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6562025-07-01T00:15:45.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = afffa0c7-cc65-4606-bdee-213fdc2041a1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6572025-07-01T00:15:45.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = afffa0c7-cc65-4606-bdee-213fdc2041a1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6582025-07-01T00:15:46.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9544ce29-2023-474a-b197-3ce5ec7c57a6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6592025-07-01T00:15:46.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9544ce29-2023-474a-b197-3ce5ec7c57a6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6602025-07-01T00:15:46.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9544ce29-2023-474a-b197-3ce5ec7c57a6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6612025-07-01T00:15:47.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2084b3fc-0122-4f8c-a73b-3d69d4425586 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6622025-07-01T00:15:47.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2084b3fc-0122-4f8c-a73b-3d69d4425586 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6632025-07-01T00:15:47.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2084b3fc-0122-4f8c-a73b-3d69d4425586 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6642025-07-01T00:15:48.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8f8dab7d-d103-468e-988e-9eb361411422 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6652025-07-01T00:15:48.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8f8dab7d-d103-468e-988e-9eb361411422 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6662025-07-01T00:15:48.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8f8dab7d-d103-468e-988e-9eb361411422 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6672025-07-01T00:15:49.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5559f4e9-ffbc-4c23-9648-c960f216a728 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6682025-07-01T00:15:49.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5559f4e9-ffbc-4c23-9648-c960f216a728 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6692025-07-01T00:15:49.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5559f4e9-ffbc-4c23-9648-c960f216a728 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6702025-07-01T00:15:50.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a1e47051-6e18-41ce-89bf-d6af50bcfc1b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6712025-07-01T00:15:50.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a1e47051-6e18-41ce-89bf-d6af50bcfc1b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6722025-07-01T00:15:50.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a1e47051-6e18-41ce-89bf-d6af50bcfc1b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6732025-07-01T00:15:51.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8dde02b7-c867-4bb6-b975-fc31df67a333 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6742025-07-01T00:15:51.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8dde02b7-c867-4bb6-b975-fc31df67a333 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6752025-07-01T00:15:51.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2869 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8dde02b7-c867-4bb6-b975-fc31df67a333 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6762025-07-01T00:15:52.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 89b3d010-f29d-4a64-b0b1-82bfdff5a3bd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6772025-07-01T00:15:52.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 89b3d010-f29d-4a64-b0b1-82bfdff5a3bd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6782025-07-01T00:15:52.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 89b3d010-f29d-4a64-b0b1-82bfdff5a3bd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6792025-07-01T00:15:53.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ce57940-e22b-4ce3-ac42-70ccaf1e9605 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6802025-07-01T00:15:53.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ce57940-e22b-4ce3-ac42-70ccaf1e9605 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6812025-07-01T00:15:53.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ce57940-e22b-4ce3-ac42-70ccaf1e9605 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
6822025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
6832025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
6842025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6852025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
6862025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6872025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6882025-07-01T00:15:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6892025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
6902025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
6912025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
6922025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6932025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6942025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6952025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
6962025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6972025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
6982025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6992025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7002025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
7012025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7022025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
7032025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7042025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
7052025-07-01T00:15:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7062025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
7072025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
7082025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7092025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7102025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7112025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
7122025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7132025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7142025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7152025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7162025-07-01T00:15:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7172025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7182025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7192025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7202025-07-01T00:15:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1283, tv_nsec: 729575797 } })
7212025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7222025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7232025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7242025-07-01T00:15:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7252025-07-01T00:15:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
7262025-07-01T00:15:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1283, tv_nsec: 730074490 } })
7272025-07-01T00:15:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
7282025-07-01T00:15:53.905ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292025-07-01T00:15:53.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7302025-07-01T00:15:53.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312025-07-01T00:15:53.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7322025-07-01T00:15:53.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332025-07-01T00:15:53.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7342025-07-01T00:15:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7352025-07-01T00:15:53.907ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.284092ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7362025-07-01T00:15:53.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372025-07-01T00:15:53.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382025-07-01T00:15:53.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.648054ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7392025-07-01T00:15:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7402025-07-01T00:15:53.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7412025-07-01T00:15:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7422025-07-01T00:15:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7432025-07-01T00:15:53.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7442025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7452025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7462025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7472025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7482025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7492025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7502025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7512025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7522025-07-01T00:15:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7532025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7542025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7552025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7562025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7572025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7582025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7592025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7602025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7612025-07-01T00:15:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7622025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
7632025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
7642025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
7652025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7662025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
7672025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7682025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
7692025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7702025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
7712025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7722025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7732025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 10 reason = Timeout
7742025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7752025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7762025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7772025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7782025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7792025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7802025-07-01T00:15:53.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.080515ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7812025-07-01T00:15:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1283, tv_nsec: 739292413 } })
7822025-07-01T00:15:53.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1283, tv_nsec: 739314343 } })
7832025-07-01T00:15:53.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
7842025-07-01T00:15:53.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852025-07-01T00:15:53.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7862025-07-01T00:15:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7872025-07-01T00:15:53.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.389246ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
7882025-07-01T00:15:53.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7892025-07-01T00:15:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7902025-07-01T00:15:53.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.952721ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
7912025-07-01T00:15:53.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7922025-07-01T00:15:53.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7932025-07-01T00:15:53.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7942025-07-01T00:15:53.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7952025-07-01T00:15:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7962025-07-01T00:15:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7972025-07-01T00:15:53.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982025-07-01T00:15:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7992025-07-01T00:15:53.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8002025-07-01T00:15:53.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8012025-07-01T00:15:53.920ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.449344ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
8022025-07-01T00:15:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
8032025-07-01T00:15:53.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8042025-07-01T00:15:53.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8052025-07-01T00:15:53.934ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
8062025-07-01T00:15:53.934ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.924526ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
8072025-07-01T00:15:53.947ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8082025-07-01T00:15:53.947ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8092025-07-01T00:15:53.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8102025-07-01T00:15:53.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8112025-07-01T00:15:53.949ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8122025-07-01T00:15:53.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8132025-07-01T00:15:53.949ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8142025-07-01T00:15:53.949ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8152025-07-01T00:15:53.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8162025-07-01T00:15:53.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8172025-07-01T00:15:53.951ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8182025-07-01T00:15:53.952ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8192025-07-01T00:15:53.952ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8202025-07-01T00:15:53.952ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 48.591049ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8212025-07-01T00:15:53.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8222025-07-01T00:15:53.953ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8232025-07-01T00:15:53.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8242025-07-01T00:15:53.954ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8252025-07-01T00:15:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8262025-07-01T00:15:53.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8272025-07-01T00:15:53.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8282025-07-01T00:15:53.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8292025-07-01T00:15:53.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8302025-07-01T00:15:53.957ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8312025-07-01T00:15:53.957ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.666768ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8322025-07-01T00:15:53.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8332025-07-01T00:15:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8342025-07-01T00:15:53.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352025-07-01T00:15:53.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8362025-07-01T00:15:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8372025-07-01T00:15:53.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.754917ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8382025-07-01T00:15:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
8392025-07-01T00:15:53.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8402025-07-01T00:15:53.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8412025-07-01T00:15:53.963ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.438793ms iteration = 10 status = 0
8422025-07-01T00:15:53.965ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 62.336976ms iteration = 12 status = {"physical_disks_added":0}
8432025-07-01T00:15:53.987ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
8442025-07-01T00:15:53.987ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 83.738871ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8452025-07-01T00:15:53.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.993145ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8462025-07-01T00:15:54.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8472025-07-01T00:15:54.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8482025-07-01T00:15:54.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8492025-07-01T00:15:54.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8502025-07-01T00:15:54.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8512025-07-01T00:15:54.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8522025-07-01T00:15:54.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8532025-07-01T00:15:54.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8542025-07-01T00:15:54.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8552025-07-01T00:15:54.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8562025-07-01T00:15:54.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
8572025-07-01T00:15:54.060ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8582025-07-01T00:15:54.060ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad728a0e-df39-45c5-8244-e68336471172", "content-length": "26", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8592025-07-01T00:15:54.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8602025-07-01T00:15:54.061ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8612025-07-01T00:15:54.090ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
8622025-07-01T00:15:54.090ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "8094ef95-3859-4091-b6b2-e0311a00a1fc", "content-length": "78", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8632025-07-01T00:15:54.090ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
8642025-07-01T00:15:54.090ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
8652025-07-01T00:15:54.090ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
8662025-07-01T00:15:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
8672025-07-01T00:15:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
8682025-07-01T00:15:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
8692025-07-01T00:15:54.092ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
8702025-07-01T00:15:54.093ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
8712025-07-01T00:15:54.093ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
8722025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
8732025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
8742025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
8752025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
8762025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
8772025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
8782025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
8792025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
8802025-07-01T00:15:54.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
8812025-07-01T00:15:54.097ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
8822025-07-01T00:15:54.097ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
8832025-07-01T00:15:54.098ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "a34ad40a-7775-443b-b769-6669f9bfc4f6", "content-length": "81", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8842025-07-01T00:15:54.098ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
8852025-07-01T00:15:54.098ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
8862025-07-01T00:15:54.098ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "af0a7a8a-dba0-47d4-8e12-b0f522886c1b", "content-length": "81", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8872025-07-01T00:15:54.152ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
8882025-07-01T00:15:54.152ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
8892025-07-01T00:15:54.153ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "76819eb8-4abc-48b9-a967-f6b38e410ea1", "content-length": "81", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8902025-07-01T00:15:54.155ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 241.682372ms iteration = 10 status = {"errors":[],"sps":[]}
8912025-07-01T00:15:54.213ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
8922025-07-01T00:15:54.213ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8932025-07-01T00:15:54.213ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6344ba1d-5ccf-443b-9644-716f4b6b1d4d", "content-length": "26", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8942025-07-01T00:15:54.213ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8952025-07-01T00:15:54.215ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8962025-07-01T00:15:54.220ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 318.933556ms iteration = 10 status = {}
8972025-07-01T00:15:54.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8982025-07-01T00:15:54.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1690e231-0c8a-486d-bbe2-f8e28266ee8b", "content-length": "691", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
8992025-07-01T00:15:54.222ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9002025-07-01T00:15:54.222ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9012025-07-01T00:15:54.222ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9022025-07-01T00:15:54.224ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.613802ms iteration = 10 status = {}
9032025-07-01T00:15:54.279ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9042025-07-01T00:15:54.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9052025-07-01T00:15:54.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ef4073-330b-4786-b943-5374dc1d3f06", "content-length": "372", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
9062025-07-01T00:15:54.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9072025-07-01T00:15:54.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9082025-07-01T00:15:54.288ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
9092025-07-01T00:15:54.288ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9102025-07-01T00:15:54.288ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2229dd9b-9762-4f1b-a558-6c01aa249d3f", "content-length": "26", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
9112025-07-01T00:15:54.288ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9122025-07-01T00:15:54.290ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
9132025-07-01T00:15:54.326ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9142025-07-01T00:15:54.326ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9152025-07-01T00:15:54.327ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "49863b18-1afa-483c-a9db-b42d30cd4cc8", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
9162025-07-01T00:15:54.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9172025-07-01T00:15:54.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9182025-07-01T00:15:54.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192025-07-01T00:15:54.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202025-07-01T00:15:54.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9212025-07-01T00:15:54.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9222025-07-01T00:15:54.337ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9232025-07-01T00:15:54.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9242025-07-01T00:15:54.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a3dd8ec7-88b5-4ddb-8a6f-a8ec76d35f43", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
9252025-07-01T00:15:54.339ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 435.69358ms iteration = 10 status = {}
9262025-07-01T00:15:54.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9272025-07-01T00:15:54.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9282025-07-01T00:15:54.377ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 476.230199ms iteration = 10 status = null
9292025-07-01T00:15:54.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9302025-07-01T00:15:54.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9312025-07-01T00:15:54.447ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
9322025-07-01T00:15:54.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9332025-07-01T00:15:54.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9342025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
9352025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
9362025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9372025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9382025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9392025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9402025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9412025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9422025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9432025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9442025-07-01T00:15:54.460ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
9452025-07-01T00:15:54.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9462025-07-01T00:15:54.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9472025-07-01T00:15:54.463ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
9482025-07-01T00:15:54.463ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9492025-07-01T00:15:54.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "06a0177d-7526-43bb-bde2-45612b8af5f3", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
9502025-07-01T00:15:54.569ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
9512025-07-01T00:15:54.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9522025-07-01T00:15:54.575ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e748fc-4b91-4951-ba8f-e1557b5ebc44", "content-length": "682", "date": "Tue, 01 Jul 2025 00:15:54 GMT"} })
9532025-07-01T00:15:54.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9542025-07-01T00:15:54.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9552025-07-01T00:15:54.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9562025-07-01T00:15:54.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9572025-07-01T00:15:54.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9582025-07-01T00:15:54.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9592025-07-01T00:15:54.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9602025-07-01T00:15:54.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9612025-07-01T00:15:54.593ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.764851ms iteration = 10 status = {}
9622025-07-01T00:15:54.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c459dd38-554f-40d8-b945-cfbabe9538ee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9632025-07-01T00:15:54.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c459dd38-554f-40d8-b945-cfbabe9538ee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9642025-07-01T00:15:54.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c459dd38-554f-40d8-b945-cfbabe9538ee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9652025-07-01T00:15:54.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 534 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 5e88c490-9f60-4ef1-b387-8efce5caa235 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
9662025-07-01T00:15:55.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ba4ac74-d721-435d-be45-f884bf4a4cf0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9672025-07-01T00:15:55.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ba4ac74-d721-435d-be45-f884bf4a4cf0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9682025-07-01T00:15:55.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ba4ac74-d721-435d-be45-f884bf4a4cf0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9692025-07-01T00:15:56.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45335d84-aa0e-42c9-b843-693606b9b46a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9702025-07-01T00:15:56.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45335d84-aa0e-42c9-b843-693606b9b46a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9712025-07-01T00:15:56.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45335d84-aa0e-42c9-b843-693606b9b46a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9722025-07-01T00:15:57.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6faf5e3e-02c4-40b6-ab02-9c2207135daa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9732025-07-01T00:15:57.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6faf5e3e-02c4-40b6-ab02-9c2207135daa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9742025-07-01T00:15:57.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6faf5e3e-02c4-40b6-ab02-9c2207135daa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9752025-07-01T00:15:58.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3c2ac0d-ba96-424d-96ff-aa7eb4db4fd4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9762025-07-01T00:15:58.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3c2ac0d-ba96-424d-96ff-aa7eb4db4fd4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9772025-07-01T00:15:58.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3c2ac0d-ba96-424d-96ff-aa7eb4db4fd4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9782025-07-01T00:15:59.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe3f7a01-0415-4d74-886b-9e3b9223649c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9792025-07-01T00:15:59.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe3f7a01-0415-4d74-886b-9e3b9223649c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9802025-07-01T00:15:59.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1823 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe3f7a01-0415-4d74-886b-9e3b9223649c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9812025-07-01T00:16:00.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2115b282-eeb3-4919-bfa8-bab7abdea353 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9822025-07-01T00:16:00.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2115b282-eeb3-4919-bfa8-bab7abdea353 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9832025-07-01T00:16:00.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2115b282-eeb3-4919-bfa8-bab7abdea353 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9842025-07-01T00:16:01.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fd3c67ed-8e3c-48a3-a6b9-47f190e43eaf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9852025-07-01T00:16:01.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fd3c67ed-8e3c-48a3-a6b9-47f190e43eaf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9862025-07-01T00:16:01.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fd3c67ed-8e3c-48a3-a6b9-47f190e43eaf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9872025-07-01T00:16:02.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 684b4038-c0ce-41a2-bc85-05cc85675943 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9882025-07-01T00:16:02.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 684b4038-c0ce-41a2-bc85-05cc85675943 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9892025-07-01T00:16:02.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1716 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 684b4038-c0ce-41a2-bc85-05cc85675943 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9902025-07-01T00:16:03.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e95597b1-a2ac-48b7-9a2e-ad421297bce5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9912025-07-01T00:16:03.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e95597b1-a2ac-48b7-9a2e-ad421297bce5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9922025-07-01T00:16:03.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e95597b1-a2ac-48b7-9a2e-ad421297bce5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
9932025-07-01T00:16:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
9942025-07-01T00:16:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
9952025-07-01T00:16:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9962025-07-01T00:16:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9972025-07-01T00:16:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9982025-07-01T00:16:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9992025-07-01T00:16:03.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10002025-07-01T00:16:03.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10012025-07-01T00:16:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022025-07-01T00:16:03.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.679981ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10032025-07-01T00:16:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10042025-07-01T00:16:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10052025-07-01T00:16:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10062025-07-01T00:16:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10072025-07-01T00:16:03.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10082025-07-01T00:16:03.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10092025-07-01T00:16:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
10102025-07-01T00:16:03.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10112025-07-01T00:16:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10122025-07-01T00:16:03.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
10132025-07-01T00:16:03.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.880821ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
10142025-07-01T00:16:04.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 59f10459-8197-49fd-a941-27b83ebad880 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10152025-07-01T00:16:04.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 59f10459-8197-49fd-a941-27b83ebad880 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10162025-07-01T00:16:04.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 59f10459-8197-49fd-a941-27b83ebad880 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10172025-07-01T00:16:04.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 570 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 8911f08a-0c77-4eaa-a144-41c87c57fbdb response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
10182025-07-01T00:16:05.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2be5fffe-6888-4eb6-907a-1787b1232b5d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10192025-07-01T00:16:05.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2be5fffe-6888-4eb6-907a-1787b1232b5d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10202025-07-01T00:16:05.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2be5fffe-6888-4eb6-907a-1787b1232b5d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10212025-07-01T00:16:06.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 34bc9a58-edbe-4c21-8063-9a335cfec5f7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10222025-07-01T00:16:06.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 34bc9a58-edbe-4c21-8063-9a335cfec5f7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10232025-07-01T00:16:06.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 34bc9a58-edbe-4c21-8063-9a335cfec5f7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10242025-07-01T00:16:07.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69a4f99e-3cf2-4f32-ade4-b991f81e56f1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10252025-07-01T00:16:07.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69a4f99e-3cf2-4f32-ade4-b991f81e56f1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10262025-07-01T00:16:07.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69a4f99e-3cf2-4f32-ade4-b991f81e56f1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10272025-07-01T00:16:08.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 568357b2-adb2-42f3-97c5-2c4beee7eda8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10282025-07-01T00:16:08.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 568357b2-adb2-42f3-97c5-2c4beee7eda8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10292025-07-01T00:16:08.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 568357b2-adb2-42f3-97c5-2c4beee7eda8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10302025-07-01T00:16:09.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 163385e3-eb5a-4495-993e-5f54581fde12 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10312025-07-01T00:16:09.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 163385e3-eb5a-4495-993e-5f54581fde12 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10322025-07-01T00:16:09.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 163385e3-eb5a-4495-993e-5f54581fde12 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10332025-07-01T00:16:10.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1fbedc4b-18bf-46bb-9dcf-20dc348959e1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10342025-07-01T00:16:10.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1fbedc4b-18bf-46bb-9dcf-20dc348959e1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10352025-07-01T00:16:10.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1fbedc4b-18bf-46bb-9dcf-20dc348959e1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10362025-07-01T00:16:11.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5ebd219c-6d89-4e96-aa1c-8545d0ffa7a3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10372025-07-01T00:16:11.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5ebd219c-6d89-4e96-aa1c-8545d0ffa7a3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10382025-07-01T00:16:11.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5ebd219c-6d89-4e96-aa1c-8545d0ffa7a3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10392025-07-01T00:16:12.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f885c74-c4cf-42d8-b48d-bb879b138dbf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10402025-07-01T00:16:12.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f885c74-c4cf-42d8-b48d-bb879b138dbf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10412025-07-01T00:16:12.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2769 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f885c74-c4cf-42d8-b48d-bb879b138dbf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10422025-07-01T00:16:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
10432025-07-01T00:16:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10442025-07-01T00:16:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
10452025-07-01T00:16:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10462025-07-01T00:16:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10472025-07-01T00:16:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10482025-07-01T00:16:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10492025-07-01T00:16:13.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10502025-07-01T00:16:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10512025-07-01T00:16:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.910447ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10522025-07-01T00:16:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10532025-07-01T00:16:13.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10542025-07-01T00:16:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10552025-07-01T00:16:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10562025-07-01T00:16:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10572025-07-01T00:16:13.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582025-07-01T00:16:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
10592025-07-01T00:16:13.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10602025-07-01T00:16:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10612025-07-01T00:16:13.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
10622025-07-01T00:16:13.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.516182ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
10632025-07-01T00:16:13.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e025fb94-08fc-4a89-a6d8-18835c9fbb06 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10642025-07-01T00:16:13.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e025fb94-08fc-4a89-a6d8-18835c9fbb06 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10652025-07-01T00:16:13.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1575 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e025fb94-08fc-4a89-a6d8-18835c9fbb06 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10662025-07-01T00:16:14.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 555 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 0233e557-ecc3-46ea-952c-ac2abfe13c27 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
10672025-07-01T00:16:14.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5510ebf-e84c-4d33-ab62-f6749d104d41 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10682025-07-01T00:16:14.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5510ebf-e84c-4d33-ab62-f6749d104d41 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10692025-07-01T00:16:14.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5510ebf-e84c-4d33-ab62-f6749d104d41 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10702025-07-01T00:16:15.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c9cf8ee-6af9-4c35-a281-0c57bf79a4c5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10712025-07-01T00:16:15.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c9cf8ee-6af9-4c35-a281-0c57bf79a4c5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10722025-07-01T00:16:15.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c9cf8ee-6af9-4c35-a281-0c57bf79a4c5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10732025-07-01T00:16:16.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd53a4c4-b0ea-4d28-a65b-1cb26e6f6509 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10742025-07-01T00:16:16.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd53a4c4-b0ea-4d28-a65b-1cb26e6f6509 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10752025-07-01T00:16:16.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd53a4c4-b0ea-4d28-a65b-1cb26e6f6509 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10762025-07-01T00:16:18.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5bacde4c-7afb-45fa-be41-11cf2ee0dae4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10772025-07-01T00:16:18.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5bacde4c-7afb-45fa-be41-11cf2ee0dae4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10782025-07-01T00:16:18.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5bacde4c-7afb-45fa-be41-11cf2ee0dae4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10792025-07-01T00:16:19.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c7fbba9-53f2-4884-862b-49d2ef5087b8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10802025-07-01T00:16:19.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c7fbba9-53f2-4884-862b-49d2ef5087b8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10812025-07-01T00:16:19.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c7fbba9-53f2-4884-862b-49d2ef5087b8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10822025-07-01T00:16:20.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4833de5e-12a6-43f9-8a26-cebea00310be roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10832025-07-01T00:16:20.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4833de5e-12a6-43f9-8a26-cebea00310be resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10842025-07-01T00:16:20.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4833de5e-12a6-43f9-8a26-cebea00310be response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10852025-07-01T00:16:21.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a6880fd7-ace5-4789-867b-c2bbc20161d0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10862025-07-01T00:16:21.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a6880fd7-ace5-4789-867b-c2bbc20161d0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10872025-07-01T00:16:21.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a6880fd7-ace5-4789-867b-c2bbc20161d0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10882025-07-01T00:16:22.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b5eabd64-a76d-420b-ba91-11054873c92f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10892025-07-01T00:16:22.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b5eabd64-a76d-420b-ba91-11054873c92f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10902025-07-01T00:16:22.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b5eabd64-a76d-420b-ba91-11054873c92f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10912025-07-01T00:16:23.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27dc9a2a-d72f-490a-8f21-eb631b28b891 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10922025-07-01T00:16:23.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27dc9a2a-d72f-490a-8f21-eb631b28b891 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10932025-07-01T00:16:23.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27dc9a2a-d72f-490a-8f21-eb631b28b891 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
10942025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
10952025-07-01T00:16:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
10962025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
10972025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.14\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
10982025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
10992025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11002025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11012025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
11022025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
11032025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
11042025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
11052025-07-01T00:16:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:06:23.901236636 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11062025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11072025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
11082025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11092025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
11102025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11112025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11122025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
11132025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
11142025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11152025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11162025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
11172025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11182025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11192025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11202025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11212025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11222025-07-01T00:16:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11232025-07-01T00:16:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1313, tv_nsec: 727477839 } })
11242025-07-01T00:16:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1313, tv_nsec: 727493330 } })
11252025-07-01T00:16:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
11262025-07-01T00:16:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.076699ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
11272025-07-01T00:16:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
11282025-07-01T00:16:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.175002ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
11292025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11302025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11312025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
11322025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
11332025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11342025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11352025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
11362025-07-01T00:16:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
11372025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11382025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
11392025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11402025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
11412025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
11422025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11432025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 9 reason = Timeout
11442025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11452025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
11462025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.01\u{b5}s iteration = 9 status = "Disabled"
11472025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11482025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
11492025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
11502025-07-01T00:16:23.903ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
11512025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11522025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11532025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
11542025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11552025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
11562025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11572025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
11582025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11592025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
11602025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11612025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
11622025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11632025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
11642025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11652025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
11662025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11672025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
11692025-07-01T00:16:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11702025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11712025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11722025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11732025-07-01T00:16:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11742025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11752025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11762025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11772025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11782025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11792025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11802025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11812025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11822025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11832025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11842025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11852025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11862025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11872025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11882025-07-01T00:16:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11892025-07-01T00:16:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.175924ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11902025-07-01T00:16:23.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:06:23.901236636 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11912025-07-01T00:16:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.538354ms iteration = 6 status = {"expiration":"2025-07-01T00:06:23.901236636Z","pruned":[]}
11922025-07-01T00:16:23.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11932025-07-01T00:16:23.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11942025-07-01T00:16:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11952025-07-01T00:16:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1313, tv_nsec: 731929841 } })
11962025-07-01T00:16:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
11972025-07-01T00:16:23.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11982025-07-01T00:16:23.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992025-07-01T00:16:23.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002025-07-01T00:16:23.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12012025-07-01T00:16:23.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12022025-07-01T00:16:23.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032025-07-01T00:16:23.909ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12042025-07-01T00:16:23.909ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12052025-07-01T00:16:23.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12062025-07-01T00:16:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12072025-07-01T00:16:23.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12082025-07-01T00:16:23.909ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1313, tv_nsec: 735501439 } })
12092025-07-01T00:16:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12102025-07-01T00:16:23.910ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
12112025-07-01T00:16:23.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12122025-07-01T00:16:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12132025-07-01T00:16:23.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12142025-07-01T00:16:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12152025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12172025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12182025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
12192025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12202025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
12212025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12222025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
12232025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
12242025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12252025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
12262025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
12272025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12282025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
12292025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
12302025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 6 reason = Timeout
12312025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
12322025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
12332025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12342025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 6 reason = Timeout
12352025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12362025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 11 reason = Timeout
12372025-07-01T00:16:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12382025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12392025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12402025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12412025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12422025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12432025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12442025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12452025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12462025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12472025-07-01T00:16:23.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1313, tv_nsec: 738720707 } })
12482025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12502025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
12512025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12522025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
12532025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
12542025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12552025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12562025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12572025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12582025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12592025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12602025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12622025-07-01T00:16:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12632025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12642025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12652025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
12662025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
12672025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12682025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
12692025-07-01T00:16:23.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12702025-07-01T00:16:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12712025-07-01T00:16:23.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12722025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12732025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12742025-07-01T00:16:23.916ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12752025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12762025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12772025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12782025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12792025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12802025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12812025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12822025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12832025-07-01T00:16:23.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.168334ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
12842025-07-01T00:16:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12852025-07-01T00:16:23.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12862025-07-01T00:16:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12872025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.547192ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
12882025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12902025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12912025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12922025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12932025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12942025-07-01T00:16:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12952025-07-01T00:16:23.919ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
12962025-07-01T00:16:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 6.60071ms iteration = 6 status = {"by_rx":{},"error":null}
12972025-07-01T00:16:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12982025-07-01T00:16:23.920ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12992025-07-01T00:16:23.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.003385ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13002025-07-01T00:16:23.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012025-07-01T00:16:23.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
13022025-07-01T00:16:23.921ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13032025-07-01T00:16:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13042025-07-01T00:16:23.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13052025-07-01T00:16:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13062025-07-01T00:16:23.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
13072025-07-01T00:16:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
13082025-07-01T00:16:23.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13092025-07-01T00:16:23.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13102025-07-01T00:16:23.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13112025-07-01T00:16:23.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13122025-07-01T00:16:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13132025-07-01T00:16:23.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13142025-07-01T00:16:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13152025-07-01T00:16:23.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13162025-07-01T00:16:23.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13172025-07-01T00:16:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13182025-07-01T00:16:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13192025-07-01T00:16:23.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202025-07-01T00:16:23.927ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
13212025-07-01T00:16:23.927ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222025-07-01T00:16:23.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
13232025-07-01T00:16:23.929ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1313, tv_nsec: 754752566 } })
13242025-07-01T00:16:23.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13252025-07-01T00:16:23.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13262025-07-01T00:16:23.929ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
13272025-07-01T00:16:23.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13282025-07-01T00:16:23.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13292025-07-01T00:16:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13302025-07-01T00:16:23.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
13312025-07-01T00:16:23.931ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
13322025-07-01T00:16:23.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
13332025-07-01T00:16:23.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13342025-07-01T00:16:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13352025-07-01T00:16:23.935ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13362025-07-01T00:16:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13372025-07-01T00:16:23.962ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13382025-07-01T00:16:23.962ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13392025-07-01T00:16:23.962ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.461099ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13402025-07-01T00:16:23.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13412025-07-01T00:16:23.967ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 54.313366ms iteration = 6 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
13422025-07-01T00:16:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
13432025-07-01T00:16:23.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13442025-07-01T00:16:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13452025-07-01T00:16:23.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13462025-07-01T00:16:23.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13472025-07-01T00:16:23.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13482025-07-01T00:16:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13492025-07-01T00:16:23.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13502025-07-01T00:16:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13512025-07-01T00:16:23.975ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13522025-07-01T00:16:23.975ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
13532025-07-01T00:16:23.975ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.145754ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13542025-07-01T00:16:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.860424ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13552025-07-01T00:16:23.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562025-07-01T00:16:23.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13572025-07-01T00:16:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13582025-07-01T00:16:23.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13592025-07-01T00:16:23.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.962932ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
13602025-07-01T00:16:23.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.194768ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
13612025-07-01T00:16:23.980ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13622025-07-01T00:16:23.980ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13632025-07-01T00:16:23.980ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13642025-07-01T00:16:23.980ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13652025-07-01T00:16:23.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13662025-07-01T00:16:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13672025-07-01T00:16:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 68.373001ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
13682025-07-01T00:16:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13692025-07-01T00:16:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13702025-07-01T00:16:23.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13712025-07-01T00:16:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13722025-07-01T00:16:23.982ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13732025-07-01T00:16:23.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13742025-07-01T00:16:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13752025-07-01T00:16:23.985ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13762025-07-01T00:16:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13772025-07-01T00:16:23.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.475316ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13782025-07-01T00:16:23.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
13792025-07-01T00:16:23.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13802025-07-01T00:16:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
13812025-07-01T00:16:23.986ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13822025-07-01T00:16:23.987ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13832025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.427742ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13842025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13852025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13862025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13872025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13882025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
13892025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13902025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13912025-07-01T00:16:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13922025-07-01T00:16:23.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13932025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13942025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13952025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13962025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13972025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13982025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13992025-07-01T00:16:23.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002025-07-01T00:16:23.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14012025-07-01T00:16:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14022025-07-01T00:16:23.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14032025-07-01T00:16:23.990ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
14042025-07-01T00:16:23.990ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.232587ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
14052025-07-01T00:16:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14062025-07-01T00:16:23.991ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14072025-07-01T00:16:23.991ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14082025-07-01T00:16:23.991ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14092025-07-01T00:16:23.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14102025-07-01T00:16:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14112025-07-01T00:16:23.992ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122025-07-01T00:16:23.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14132025-07-01T00:16:23.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14142025-07-01T00:16:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14152025-07-01T00:16:23.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14162025-07-01T00:16:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14172025-07-01T00:16:23.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14182025-07-01T00:16:23.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14192025-07-01T00:16:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14202025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
14212025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14222025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14232025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
14242025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14252025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
14262025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 95.560915ms iteration = 6 status = {"generation":2}
14272025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14282025-07-01T00:16:23.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14292025-07-01T00:16:23.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14302025-07-01T00:16:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14312025-07-01T00:16:23.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14322025-07-01T00:16:23.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14332025-07-01T00:16:23.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14342025-07-01T00:16:24.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14352025-07-01T00:16:24.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14362025-07-01T00:16:24.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14372025-07-01T00:16:24.000ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.100146ms iteration = 11 status = 0
14382025-07-01T00:16:24.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14392025-07-01T00:16:24.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14402025-07-01T00:16:24.004ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
14412025-07-01T00:16:24.004ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14422025-07-01T00:16:24.004ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
14432025-07-01T00:16:24.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 103.053019ms iteration = 6 status = {"generation":1}
14442025-07-01T00:16:24.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14452025-07-01T00:16:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14462025-07-01T00:16:24.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14472025-07-01T00:16:24.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14482025-07-01T00:16:24.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14492025-07-01T00:16:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14502025-07-01T00:16:24.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14512025-07-01T00:16:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14522025-07-01T00:16:24.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14532025-07-01T00:16:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14542025-07-01T00:16:24.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552025-07-01T00:16:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14562025-07-01T00:16:24.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14572025-07-01T00:16:24.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14582025-07-01T00:16:24.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14592025-07-01T00:16:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14602025-07-01T00:16:24.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14612025-07-01T00:16:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14622025-07-01T00:16:24.025ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
14632025-07-01T00:16:24.025ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 122.363548ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14642025-07-01T00:16:24.027ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.070254ms iteration = 13 status = {"physical_disks_added":0}
14652025-07-01T00:16:24.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14662025-07-01T00:16:24.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14672025-07-01T00:16:24.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14682025-07-01T00:16:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14692025-07-01T00:16:24.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14702025-07-01T00:16:24.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14712025-07-01T00:16:24.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14722025-07-01T00:16:24.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14732025-07-01T00:16:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14742025-07-01T00:16:24.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14752025-07-01T00:16:24.033ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14762025-07-01T00:16:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14772025-07-01T00:16:24.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14782025-07-01T00:16:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.644101ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14792025-07-01T00:16:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14802025-07-01T00:16:24.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812025-07-01T00:16:24.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822025-07-01T00:16:24.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
14832025-07-01T00:16:24.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14842025-07-01T00:16:24.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14852025-07-01T00:16:24.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862025-07-01T00:16:24.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14872025-07-01T00:16:24.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14882025-07-01T00:16:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14892025-07-01T00:16:24.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
14902025-07-01T00:16:24.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14912025-07-01T00:16:24.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14922025-07-01T00:16:24.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14932025-07-01T00:16:24.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14942025-07-01T00:16:24.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14952025-07-01T00:16:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14962025-07-01T00:16:24.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
14972025-07-01T00:16:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
14982025-07-01T00:16:24.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14992025-07-01T00:16:24.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15002025-07-01T00:16:24.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15012025-07-01T00:16:24.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15022025-07-01T00:16:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15032025-07-01T00:16:24.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15042025-07-01T00:16:24.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15052025-07-01T00:16:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15062025-07-01T00:16:24.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072025-07-01T00:16:24.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
15082025-07-01T00:16:24.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
15092025-07-01T00:16:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
15102025-07-01T00:16:24.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15112025-07-01T00:16:24.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15122025-07-01T00:16:24.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15132025-07-01T00:16:24.056ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
15142025-07-01T00:16:24.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15152025-07-01T00:16:24.056ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 153.255863ms iteration = 4 status = {"blueprint_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","inventory_collection_id":"1cc8d96f-eaa9-4d6a-85c0-6989122fe188","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
15162025-07-01T00:16:24.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15172025-07-01T00:16:24.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15182025-07-01T00:16:24.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15192025-07-01T00:16:24.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15202025-07-01T00:16:24.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15212025-07-01T00:16:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15222025-07-01T00:16:24.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15232025-07-01T00:16:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15242025-07-01T00:16:24.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15252025-07-01T00:16:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15262025-07-01T00:16:24.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15272025-07-01T00:16:24.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15282025-07-01T00:16:24.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15292025-07-01T00:16:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15302025-07-01T00:16:24.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15312025-07-01T00:16:24.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15322025-07-01T00:16:24.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15332025-07-01T00:16:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15342025-07-01T00:16:24.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15352025-07-01T00:16:24.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15362025-07-01T00:16:24.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15372025-07-01T00:16:24.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15382025-07-01T00:16:24.085ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15392025-07-01T00:16:24.087ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
15402025-07-01T00:16:24.087ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.551024ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15412025-07-01T00:16:24.091ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f274681-7557-4e69-bb36-c34e43fd83b4, kind: Service { id: 021f35b4-60a5-480d-bcf4-37411a034e6a }, name: Name("nexus-021f35b4-60a5-480d-bcf4-37411a034e6a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 854adf72-e8e4-4b08-88d2-091cbe26a690, kind: Service { id: 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6 }, name: Name("nexus-8da13144-b1e3-4f04-bf20-cd1fcf6b40c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 31])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d06d12c1-c26d-48d7-b479-dfb11b5f2c03, kind: Service { id: e258d80d-279a-4e4d-8211-359a29b37a8c }, name: Name("nexus-e258d80d-279a-4e4d-8211-359a29b37a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 7e1b4ef2-2e3d-423a-9b28-b3d9bb193acd, kind: Service { id: e0ddf814-75e5-4f70-adea-4a3baebe5d2e }, name: Name("external-dns-e0ddf814-75e5-4f70-adea-4a3baebe5d2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3199264-c95c-4efe-8cbb-2197130f77ca, kind: Service { id: 41eebb95-a44a-4913-b805-5e5fb485fcae }, name: Name("external-dns-41eebb95-a44a-4913-b805-5e5fb485fcae"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
15422025-07-01T00:16:24.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15432025-07-01T00:16:24.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15442025-07-01T00:16:24.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15452025-07-01T00:16:24.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
15462025-07-01T00:16:24.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
15472025-07-01T00:16:24.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
15482025-07-01T00:16:24.097ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
15492025-07-01T00:16:24.097ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 193.759462ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15502025-07-01T00:16:24.106ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15512025-07-01T00:16:24.109ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
15522025-07-01T00:16:24.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a15d0852-824d-41cd-8fc9-c97493a8b3e6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
15532025-07-01T00:16:24.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a15d0852-824d-41cd-8fc9-c97493a8b3e6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
15542025-07-01T00:16:24.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a15d0852-824d-41cd-8fc9-c97493a8b3e6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
15552025-07-01T00:16:24.114ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7e1b4ef2-2e3d-423a-9b28-b3d9bb193acd, kind: Service { id: e0ddf814-75e5-4f70-adea-4a3baebe5d2e }, name: Name("external-dns-e0ddf814-75e5-4f70-adea-4a3baebe5d2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3199264-c95c-4efe-8cbb-2197130f77ca, kind: Service { id: 41eebb95-a44a-4913-b805-5e5fb485fcae }, name: Name("external-dns-41eebb95-a44a-4913-b805-5e5fb485fcae"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f274681-7557-4e69-bb36-c34e43fd83b4, kind: Service { id: 021f35b4-60a5-480d-bcf4-37411a034e6a }, name: Name("nexus-021f35b4-60a5-480d-bcf4-37411a034e6a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 854adf72-e8e4-4b08-88d2-091cbe26a690, kind: Service { id: 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6 }, name: Name("nexus-8da13144-b1e3-4f04-bf20-cd1fcf6b40c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 31])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d06d12c1-c26d-48d7-b479-dfb11b5f2c03, kind: Service { id: e258d80d-279a-4e4d-8211-359a29b37a8c }, name: Name("nexus-e258d80d-279a-4e4d-8211-359a29b37a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
15562025-07-01T00:16:24.114ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
15572025-07-01T00:16:24.137ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
15582025-07-01T00:16:24.137ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e7fe7f6-bbd5-4e68-8d85-d54fcc515bf5", "content-length": "78", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
15592025-07-01T00:16:24.137ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
15602025-07-01T00:16:24.137ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
15612025-07-01T00:16:24.138ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
15622025-07-01T00:16:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
15632025-07-01T00:16:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
15642025-07-01T00:16:24.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
15652025-07-01T00:16:24.140ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
15662025-07-01T00:16:24.141ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
15672025-07-01T00:16:24.141ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
15682025-07-01T00:16:24.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
15692025-07-01T00:16:24.145ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
15702025-07-01T00:16:24.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
15712025-07-01T00:16:24.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
15722025-07-01T00:16:24.146ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
15732025-07-01T00:16:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
15742025-07-01T00:16:24.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
15752025-07-01T00:16:24.146ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
15762025-07-01T00:16:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
15772025-07-01T00:16:24.152ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
15782025-07-01T00:16:24.152ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
15792025-07-01T00:16:24.153ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "26dafd13-dc1a-48e7-b421-19f6f49459f9", "content-length": "81", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
15802025-07-01T00:16:24.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
15812025-07-01T00:16:24.198ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15822025-07-01T00:16:24.199ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90c3d2fc-d733-41a9-a978-da4c5716d924", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
15832025-07-01T00:16:24.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15842025-07-01T00:16:24.199ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15852025-07-01T00:16:24.199ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15862025-07-01T00:16:24.200ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "78f267b1-b0d4-4941-a725-9d273aa22ad1", "content-length": "372", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
15872025-07-01T00:16:24.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15882025-07-01T00:16:24.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15892025-07-01T00:16:24.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15902025-07-01T00:16:24.210ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
15912025-07-01T00:16:24.210ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
15922025-07-01T00:16:24.211ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
15932025-07-01T00:16:24.211ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
15942025-07-01T00:16:24.211ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f7128b3-541b-4f9b-b0da-5667dd2bc912", "content-length": "81", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
15952025-07-01T00:16:24.212ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "74481297-183e-4d13-8a60-eb7b5dc07fe1", "content-length": "81", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
15962025-07-01T00:16:24.214ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 302.004233ms iteration = 11 status = {"errors":[],"sps":[]}
15972025-07-01T00:16:24.217ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 887ec56b-486c-42d4-930b-b7b47cbacc61, time_created: 2025-07-01T00:11:35.920338Z, time_modified: 2025-07-01T00:11:35.920338Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
15982025-07-01T00:16:24.217ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
15992025-07-01T00:16:24.222ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16002025-07-01T00:16:24.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16012025-07-01T00:16:24.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "213e5ba5-84b2-4b60-85f4-0a6c8a924942", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16022025-07-01T00:16:24.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16032025-07-01T00:16:24.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16042025-07-01T00:16:24.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16052025-07-01T00:16:24.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16062025-07-01T00:16:24.226ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
16072025-07-01T00:16:24.226ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16082025-07-01T00:16:24.226ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d91d6c3f-01ac-4b30-97cf-a5b458574b98", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16092025-07-01T00:16:24.226ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16102025-07-01T00:16:24.228ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
16112025-07-01T00:16:24.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16122025-07-01T00:16:24.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16132025-07-01T00:16:24.241ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16142025-07-01T00:16:24.241ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16152025-07-01T00:16:24.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7194cac5-61d4-4679-8d73-69f5a5fc3847", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16162025-07-01T00:16:24.250ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 346.326146ms iteration = 11 status = {}
16172025-07-01T00:16:24.327ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
16182025-07-01T00:16:24.327ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16192025-07-01T00:16:24.327ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83c89244-ce42-4ef7-ab6c-faf55239af91", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16202025-07-01T00:16:24.327ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16212025-07-01T00:16:24.329ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16222025-07-01T00:16:24.344ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16232025-07-01T00:16:24.344ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3cba544-118c-4411-856e-c215d2345970", "content-length": "691", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16242025-07-01T00:16:24.344ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16252025-07-01T00:16:24.344ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16262025-07-01T00:16:24.344ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16272025-07-01T00:16:24.349ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 446.29494ms iteration = 11 status = {}
16282025-07-01T00:16:24.351ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
16292025-07-01T00:16:24.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
16302025-07-01T00:16:24.353ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312025-07-01T00:16:24.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
16322025-07-01T00:16:24.357ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
16332025-07-01T00:16:24.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
16342025-07-01T00:16:24.359ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
16352025-07-01T00:16:24.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
16362025-07-01T00:16:24.361ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372025-07-01T00:16:24.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
16382025-07-01T00:16:24.364ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
16392025-07-01T00:16:24.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
16402025-07-01T00:16:24.367ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
16412025-07-01T00:16:24.368ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "6e61d201-0d70-4c7a-a4dd-183688cd3f8a", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16422025-07-01T00:16:24.368ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
16432025-07-01T00:16:24.369ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "79b4acc1-7b35-4628-86f2-48f3094ccfe0", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16442025-07-01T00:16:24.369ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:669 sled = http://[fd00:1122:3344:101::1]:12345
16452025-07-01T00:16:24.370ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 458.102903ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"887ec56b-486c-42d4-930b-b7b47cbacc61","time":"2025-07-01T00:16:24.368804678Z"},{"operation":"list","target_sled":"887ec56b-486c-42d4-930b-b7b47cbacc61","time":"2025-07-01T00:16:24.369090216Z"}]}
16462025-07-01T00:16:24.371ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16472025-07-01T00:16:24.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9eeb7fe1-53f9-4413-85b9-27e8e5c885f1", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16482025-07-01T00:16:24.372ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16492025-07-01T00:16:24.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6083b2a5-f37e-4f78-bb49-3f2d94491ea3", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16502025-07-01T00:16:24.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16512025-07-01T00:16:24.376ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16522025-07-01T00:16:24.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 474.876441ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16532025-07-01T00:16:24.388ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16542025-07-01T00:16:24.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16552025-07-01T00:16:24.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16562025-07-01T00:16:24.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
16572025-07-01T00:16:24.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
16582025-07-01T00:16:24.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592025-07-01T00:16:24.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
16602025-07-01T00:16:24.478ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16612025-07-01T00:16:24.479ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "11be7eba-d27a-4dc0-abcb-c8688c6b35bb", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16622025-07-01T00:16:24.480ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
16632025-07-01T00:16:24.480ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 577.290854ms
16642025-07-01T00:16:24.480ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 577.298094ms iteration = 2 status = {}
16652025-07-01T00:16:24.508ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16662025-07-01T00:16:24.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16672025-07-01T00:16:24.510ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 609.399393ms iteration = 11 status = null
16682025-07-01T00:16:24.519ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 617.809682ms iteration = 11 status = {}
16692025-07-01T00:16:24.549ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16702025-07-01T00:16:24.549ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "abd4e0fc-9ca4-4a47-9036-69f622337492", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16712025-07-01T00:16:24.549ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16722025-07-01T00:16:24.551ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "08df75c2-a4fa-4988-966d-10caa9e34b4e", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16732025-07-01T00:16:24.551ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16742025-07-01T00:16:24.553ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e962f14c-0c82-42ff-a69f-a02e42be5c20", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16752025-07-01T00:16:24.553ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16762025-07-01T00:16:24.555ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16772025-07-01T00:16:24.555ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 654.353083ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16782025-07-01T00:16:24.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16792025-07-01T00:16:24.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16802025-07-01T00:16:24.587ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
16812025-07-01T00:16:24.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16822025-07-01T00:16:24.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16832025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
16842025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
16852025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16862025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16872025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16882025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16892025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16902025-07-01T00:16:24.596ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16912025-07-01T00:16:24.597ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16922025-07-01T00:16:24.597ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16932025-07-01T00:16:24.597ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
16942025-07-01T00:16:24.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16952025-07-01T00:16:24.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16962025-07-01T00:16:24.600ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
16972025-07-01T00:16:24.600ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16982025-07-01T00:16:24.703ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "487e4926-5fc0-41bd-8d46-a66d6b161d98", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
16992025-07-01T00:16:24.703ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
17002025-07-01T00:16:24.703ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17012025-07-01T00:16:24.703ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2c39a4a-35e6-441e-afd6-fafd48ea7bd6", "content-length": "682", "date": "Tue, 01 Jul 2025 00:16:24 GMT"} })
17022025-07-01T00:16:24.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17032025-07-01T00:16:24.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17042025-07-01T00:16:24.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17052025-07-01T00:16:24.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17062025-07-01T00:16:24.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17072025-07-01T00:16:24.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17082025-07-01T00:16:24.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17092025-07-01T00:16:24.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17102025-07-01T00:16:24.719ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 815.998645ms iteration = 11 status = {}
17112025-07-01T00:16:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 512 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = dbaac67f-805a-4777-961a-df73b6f3af60 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
17122025-07-01T00:16:25.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e1ce4220-ca36-41bd-918b-44e3c623ead7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17132025-07-01T00:16:25.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e1ce4220-ca36-41bd-918b-44e3c623ead7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17142025-07-01T00:16:25.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e1ce4220-ca36-41bd-918b-44e3c623ead7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17152025-07-01T00:16:26.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01b42587-e140-4517-a654-20cce461802a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17162025-07-01T00:16:26.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01b42587-e140-4517-a654-20cce461802a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17172025-07-01T00:16:26.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01b42587-e140-4517-a654-20cce461802a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17182025-07-01T00:16:27.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5891150b-ba34-46e7-936a-0ad64f242b7e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17192025-07-01T00:16:27.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5891150b-ba34-46e7-936a-0ad64f242b7e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17202025-07-01T00:16:27.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5891150b-ba34-46e7-936a-0ad64f242b7e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17212025-07-01T00:16:28.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 93979442-1aad-41f1-b301-115ba461c36b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17222025-07-01T00:16:28.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 93979442-1aad-41f1-b301-115ba461c36b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17232025-07-01T00:16:28.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 93979442-1aad-41f1-b301-115ba461c36b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17242025-07-01T00:16:29.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e75667ab-2973-4b33-9e7a-c4033509bcf3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17252025-07-01T00:16:29.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e75667ab-2973-4b33-9e7a-c4033509bcf3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17262025-07-01T00:16:29.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e75667ab-2973-4b33-9e7a-c4033509bcf3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17272025-07-01T00:16:30.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b3cc3b45-ddc7-4c75-9183-c523ff0e9a6b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17282025-07-01T00:16:30.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b3cc3b45-ddc7-4c75-9183-c523ff0e9a6b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17292025-07-01T00:16:30.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b3cc3b45-ddc7-4c75-9183-c523ff0e9a6b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17302025-07-01T00:16:31.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 84f11ecb-f48f-48b1-a85c-3f2e4c586961 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17312025-07-01T00:16:31.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 84f11ecb-f48f-48b1-a85c-3f2e4c586961 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17322025-07-01T00:16:31.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 84f11ecb-f48f-48b1-a85c-3f2e4c586961 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17332025-07-01T00:16:32.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e3cda42-5586-4b1e-93af-d8a715357bb8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17342025-07-01T00:16:32.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e3cda42-5586-4b1e-93af-d8a715357bb8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17352025-07-01T00:16:32.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e3cda42-5586-4b1e-93af-d8a715357bb8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17362025-07-01T00:16:33.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2193abd3-ee4a-4d9d-abce-b360c97399f0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17372025-07-01T00:16:33.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2193abd3-ee4a-4d9d-abce-b360c97399f0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17382025-07-01T00:16:33.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2193abd3-ee4a-4d9d-abce-b360c97399f0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17392025-07-01T00:16:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
17402025-07-01T00:16:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17412025-07-01T00:16:33.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
17422025-07-01T00:16:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432025-07-01T00:16:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17442025-07-01T00:16:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17452025-07-01T00:16:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17462025-07-01T00:16:33.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17472025-07-01T00:16:33.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17482025-07-01T00:16:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17492025-07-01T00:16:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17502025-07-01T00:16:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17512025-07-01T00:16:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17522025-07-01T00:16:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17532025-07-01T00:16:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17542025-07-01T00:16:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
17552025-07-01T00:16:33.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17562025-07-01T00:16:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17572025-07-01T00:16:33.927ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
17582025-07-01T00:16:33.927ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.12044ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
17592025-07-01T00:16:33.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.809574ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17602025-07-01T00:16:34.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ccd7ca57-632b-4c2d-a392-324c467e7d49 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17612025-07-01T00:16:34.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ccd7ca57-632b-4c2d-a392-324c467e7d49 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17622025-07-01T00:16:34.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ccd7ca57-632b-4c2d-a392-324c467e7d49 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17632025-07-01T00:16:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = e0fc4fee-6bf8-4a0f-9a2c-37010022c95e response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
17642025-07-01T00:16:35.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a9c02049-a91a-46cb-912b-7908d38180a9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17652025-07-01T00:16:35.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a9c02049-a91a-46cb-912b-7908d38180a9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17662025-07-01T00:16:35.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a9c02049-a91a-46cb-912b-7908d38180a9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17672025-07-01T00:16:36.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = efc48a6f-69df-4efc-a376-9f4d166d3f1b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17682025-07-01T00:16:36.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = efc48a6f-69df-4efc-a376-9f4d166d3f1b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17692025-07-01T00:16:36.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = efc48a6f-69df-4efc-a376-9f4d166d3f1b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17702025-07-01T00:16:37.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b67e8f8d-2853-43d4-96a6-5a867ebde830 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17712025-07-01T00:16:37.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b67e8f8d-2853-43d4-96a6-5a867ebde830 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17722025-07-01T00:16:37.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b67e8f8d-2853-43d4-96a6-5a867ebde830 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17732025-07-01T00:16:38.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 24d8b218-3ce5-4c23-bbf4-2448083ce09f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17742025-07-01T00:16:38.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 24d8b218-3ce5-4c23-bbf4-2448083ce09f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17752025-07-01T00:16:38.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 24d8b218-3ce5-4c23-bbf4-2448083ce09f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17762025-07-01T00:16:39.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 37d29e48-680b-4659-9d21-8ce3af74e21e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17772025-07-01T00:16:39.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 37d29e48-680b-4659-9d21-8ce3af74e21e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17782025-07-01T00:16:39.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 37d29e48-680b-4659-9d21-8ce3af74e21e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17792025-07-01T00:16:40.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bee8567d-2d7f-47cf-9149-5195957f6e91 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17802025-07-01T00:16:40.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bee8567d-2d7f-47cf-9149-5195957f6e91 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17812025-07-01T00:16:40.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bee8567d-2d7f-47cf-9149-5195957f6e91 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17822025-07-01T00:16:41.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa209e86-26d5-410e-be63-324f652d0aa1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17832025-07-01T00:16:41.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa209e86-26d5-410e-be63-324f652d0aa1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17842025-07-01T00:16:41.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa209e86-26d5-410e-be63-324f652d0aa1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17852025-07-01T00:16:42.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5cf8bee0-82a2-4bd9-a65a-9aec106a0cab roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17862025-07-01T00:16:42.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5cf8bee0-82a2-4bd9-a65a-9aec106a0cab resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17872025-07-01T00:16:42.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5cf8bee0-82a2-4bd9-a65a-9aec106a0cab response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17882025-07-01T00:16:43.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3881a7f2-003d-42fa-ac89-d6d87e601fd9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17892025-07-01T00:16:43.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3881a7f2-003d-42fa-ac89-d6d87e601fd9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17902025-07-01T00:16:43.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3881a7f2-003d-42fa-ac89-d6d87e601fd9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
17912025-07-01T00:16:43.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
17922025-07-01T00:16:43.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
17932025-07-01T00:16:43.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17942025-07-01T00:16:43.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17952025-07-01T00:16:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17962025-07-01T00:16:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17972025-07-01T00:16:43.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17982025-07-01T00:16:43.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17992025-07-01T00:16:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18002025-07-01T00:16:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.603996ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18012025-07-01T00:16:43.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18022025-07-01T00:16:43.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18032025-07-01T00:16:43.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18042025-07-01T00:16:43.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18052025-07-01T00:16:43.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18062025-07-01T00:16:43.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072025-07-01T00:16:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
18082025-07-01T00:16:43.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18092025-07-01T00:16:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18102025-07-01T00:16:43.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
18112025-07-01T00:16:43.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.478401ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
18122025-07-01T00:16:44.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 186e281d-fecf-4054-9a04-ab6a06d6053c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18132025-07-01T00:16:44.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 186e281d-fecf-4054-9a04-ab6a06d6053c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18142025-07-01T00:16:44.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 186e281d-fecf-4054-9a04-ab6a06d6053c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18152025-07-01T00:16:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 866 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 1ff3fb69-85f0-4568-ba57-390acaa8c31e response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
18162025-07-01T00:16:45.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 848b07ae-fba5-483a-8cfe-776d8afc48d1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18172025-07-01T00:16:45.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 848b07ae-fba5-483a-8cfe-776d8afc48d1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18182025-07-01T00:16:45.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 848b07ae-fba5-483a-8cfe-776d8afc48d1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18192025-07-01T00:16:46.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8413071-1376-44a6-804c-66ce8510cd16 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18202025-07-01T00:16:46.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8413071-1376-44a6-804c-66ce8510cd16 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18212025-07-01T00:16:46.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8413071-1376-44a6-804c-66ce8510cd16 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18222025-07-01T00:16:47.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c88d7f55-8e54-4300-a086-1287e92857e1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18232025-07-01T00:16:47.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c88d7f55-8e54-4300-a086-1287e92857e1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18242025-07-01T00:16:47.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c88d7f55-8e54-4300-a086-1287e92857e1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18252025-07-01T00:16:48.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3bef804-feed-48f6-a1f4-63fbc25956a6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18262025-07-01T00:16:48.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3bef804-feed-48f6-a1f4-63fbc25956a6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18272025-07-01T00:16:48.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3bef804-feed-48f6-a1f4-63fbc25956a6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18282025-07-01T00:16:49.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 003ae333-fd09-423f-86a8-ea350f18fec2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18292025-07-01T00:16:49.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 003ae333-fd09-423f-86a8-ea350f18fec2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18302025-07-01T00:16:49.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 003ae333-fd09-423f-86a8-ea350f18fec2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18312025-07-01T00:16:49.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:35238
18322025-07-01T00:16:49.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 7c3deb12-6267-4c3f-9db0-1b9c09cbd4cb roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
18332025-07-01T00:16:49.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 7c3deb12-6267-4c3f-9db0-1b9c09cbd4cb resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
18342025-07-01T00:16:49.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 7c3deb12-6267-4c3f-9db0-1b9c09cbd4cb response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
18352025-07-01T00:16:49.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 387b7cf6-5911-49c3-93f5-ee0d6b94b91a roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
18362025-07-01T00:16:49.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 387b7cf6-5911-49c3-93f5-ee0d6b94b91a resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
18372025-07-01T00:16:49.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2997 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 387b7cf6-5911-49c3-93f5-ee0d6b94b91a response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
18382025-07-01T00:16:50.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e70e08e8-fb8a-4118-940c-30e273a66813 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18392025-07-01T00:16:50.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e70e08e8-fb8a-4118-940c-30e273a66813 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18402025-07-01T00:16:50.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e70e08e8-fb8a-4118-940c-30e273a66813 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18412025-07-01T00:16:51.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e41dc1e-6672-414d-97e6-c3d66b717ef4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18422025-07-01T00:16:51.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e41dc1e-6672-414d-97e6-c3d66b717ef4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18432025-07-01T00:16:51.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e41dc1e-6672-414d-97e6-c3d66b717ef4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18442025-07-01T00:16:52.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d14fc170-e09c-411e-a5da-e1df28ace6ef roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18452025-07-01T00:16:52.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d14fc170-e09c-411e-a5da-e1df28ace6ef resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18462025-07-01T00:16:52.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d14fc170-e09c-411e-a5da-e1df28ace6ef response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18472025-07-01T00:16:53.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ba160c9-1f06-45e5-aa9c-ca8527621766 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18482025-07-01T00:16:53.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ba160c9-1f06-45e5-aa9c-ca8527621766 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18492025-07-01T00:16:53.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ba160c9-1f06-45e5-aa9c-ca8527621766 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
18502025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
18512025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
18522025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
18532025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18542025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18552025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18562025-07-01T00:16:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18572025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
18582025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18592025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
18602025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18612025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
18622025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18632025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18642025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
18652025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18662025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
18672025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
18682025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18692025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
18702025-07-01T00:16:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18712025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18722025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18732025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
18742025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18752025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
18762025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18772025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
18782025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
18792025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18802025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18812025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18822025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18832025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18842025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18852025-07-01T00:16:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18862025-07-01T00:16:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18872025-07-01T00:16:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18882025-07-01T00:16:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18892025-07-01T00:16:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18902025-07-01T00:16:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18912025-07-01T00:16:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18922025-07-01T00:16:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1343, tv_nsec: 729956317 } })
18932025-07-01T00:16:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1343, tv_nsec: 730008439 } })
18942025-07-01T00:16:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
18952025-07-01T00:16:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
18962025-07-01T00:16:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.109632ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18972025-07-01T00:16:53.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18982025-07-01T00:16:53.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18992025-07-01T00:16:53.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002025-07-01T00:16:53.906ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19012025-07-01T00:16:53.906ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19022025-07-01T00:16:53.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19032025-07-01T00:16:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19042025-07-01T00:16:53.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052025-07-01T00:16:53.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-07-01T00:16:53.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072025-07-01T00:16:53.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19082025-07-01T00:16:53.909ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19092025-07-01T00:16:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19102025-07-01T00:16:53.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19112025-07-01T00:16:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19122025-07-01T00:16:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19132025-07-01T00:16:53.909ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19142025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19152025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19162025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19172025-07-01T00:16:53.910ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19182025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19192025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19202025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19212025-07-01T00:16:53.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.359692ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19222025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19232025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19242025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19252025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19262025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19272025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19282025-07-01T00:16:53.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19292025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19302025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.517342ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19312025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19322025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19332025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19342025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19352025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19362025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19372025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
19392025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
19402025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19412025-07-01T00:16:53.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
19422025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
19432025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19442025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 12 reason = Timeout
19452025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
19462025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19472025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
19482025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19492025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19502025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19512025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19522025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
19532025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19542025-07-01T00:16:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1343, tv_nsec: 738766288 } })
19552025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19562025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19572025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19582025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19592025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19602025-07-01T00:16:53.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19612025-07-01T00:16:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19622025-07-01T00:16:53.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19632025-07-01T00:16:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19642025-07-01T00:16:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19652025-07-01T00:16:53.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19662025-07-01T00:16:53.915ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1343, tv_nsec: 741308408 } })
19672025-07-01T00:16:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19682025-07-01T00:16:53.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.036983ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
19692025-07-01T00:16:53.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19702025-07-01T00:16:53.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19712025-07-01T00:16:53.916ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
19722025-07-01T00:16:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19732025-07-01T00:16:53.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19742025-07-01T00:16:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19752025-07-01T00:16:53.918ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19762025-07-01T00:16:53.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19772025-07-01T00:16:53.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19782025-07-01T00:16:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19792025-07-01T00:16:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19802025-07-01T00:16:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19812025-07-01T00:16:53.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19822025-07-01T00:16:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19832025-07-01T00:16:53.948ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19842025-07-01T00:16:53.948ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19852025-07-01T00:16:53.948ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 45.472133ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19862025-07-01T00:16:53.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19872025-07-01T00:16:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19882025-07-01T00:16:53.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19892025-07-01T00:16:53.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19902025-07-01T00:16:53.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.25387ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19912025-07-01T00:16:53.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19922025-07-01T00:16:53.958ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19932025-07-01T00:16:53.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19942025-07-01T00:16:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19952025-07-01T00:16:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
19962025-07-01T00:16:53.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19972025-07-01T00:16:53.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19982025-07-01T00:16:53.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
19992025-07-01T00:16:53.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20002025-07-01T00:16:53.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20012025-07-01T00:16:53.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.943493ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
20022025-07-01T00:16:53.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20032025-07-01T00:16:53.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20042025-07-01T00:16:53.964ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.471582ms iteration = 12 status = 0
20052025-07-01T00:16:53.965ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20062025-07-01T00:16:53.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.942545ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20072025-07-01T00:16:53.967ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 54.179173ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
20082025-07-01T00:16:53.967ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
20092025-07-01T00:16:53.967ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 63.999451ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20102025-07-01T00:16:53.978ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
20112025-07-01T00:16:53.978ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.171497ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
20122025-07-01T00:16:53.997ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20132025-07-01T00:16:53.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20142025-07-01T00:16:53.999ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.059725ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20152025-07-01T00:16:54.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20162025-07-01T00:16:54.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20172025-07-01T00:16:54.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20182025-07-01T00:16:54.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20192025-07-01T00:16:54.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202025-07-01T00:16:54.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20212025-07-01T00:16:54.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20222025-07-01T00:16:54.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20232025-07-01T00:16:54.047ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.033941ms iteration = 14 status = {"physical_disks_added":0}
20242025-07-01T00:16:54.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
20252025-07-01T00:16:54.069ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20262025-07-01T00:16:54.069ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c64f94dc-b120-44ca-b328-7770b6029ee0", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20272025-07-01T00:16:54.069ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20282025-07-01T00:16:54.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20292025-07-01T00:16:54.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
20302025-07-01T00:16:54.078ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20312025-07-01T00:16:54.078ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a3a993b-d930-48f7-86e3-1afd602f7765", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20322025-07-01T00:16:54.078ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20332025-07-01T00:16:54.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
20342025-07-01T00:16:54.086ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20352025-07-01T00:16:54.086ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20362025-07-01T00:16:54.087ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f8d8187-cd89-4eec-bf09-f94f71a07165", "content-length": "372", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20372025-07-01T00:16:54.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20382025-07-01T00:16:54.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20392025-07-01T00:16:54.103ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20402025-07-01T00:16:54.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20412025-07-01T00:16:54.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0816d4d0-8253-47e6-8e9f-df3c43eed78b", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20422025-07-01T00:16:54.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20432025-07-01T00:16:54.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20442025-07-01T00:16:54.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20452025-07-01T00:16:54.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20462025-07-01T00:16:54.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20472025-07-01T00:16:54.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20482025-07-01T00:16:54.115ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20492025-07-01T00:16:54.115ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20502025-07-01T00:16:54.115ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e1c10ef6-ac79-4831-9ec3-af59d2f45446", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20512025-07-01T00:16:54.117ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 213.915103ms iteration = 12 status = {}
20522025-07-01T00:16:54.183ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
20532025-07-01T00:16:54.183ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20542025-07-01T00:16:54.184ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec5800b3-4530-47ec-bebb-3edbeb0d6052", "content-length": "26", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20552025-07-01T00:16:54.184ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20562025-07-01T00:16:54.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20572025-07-01T00:16:54.196ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
20582025-07-01T00:16:54.196ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "b79a457f-9bdd-47cb-b2a0-8dd1a0f77fa8", "content-length": "78", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20592025-07-01T00:16:54.196ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
20602025-07-01T00:16:54.196ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
20612025-07-01T00:16:54.196ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
20622025-07-01T00:16:54.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
20632025-07-01T00:16:54.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
20642025-07-01T00:16:54.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20652025-07-01T00:16:54.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
20662025-07-01T00:16:54.198ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "227bfa07-aa82-4cf4-a188-7ca6815ba872", "content-length": "691", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20672025-07-01T00:16:54.198ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20682025-07-01T00:16:54.198ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20692025-07-01T00:16:54.198ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20702025-07-01T00:16:54.199ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
20712025-07-01T00:16:54.199ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 296.003709ms iteration = 12 status = {}
20722025-07-01T00:16:54.199ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
20732025-07-01T00:16:54.200ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
20742025-07-01T00:16:54.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
20752025-07-01T00:16:54.202ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
20762025-07-01T00:16:54.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
20772025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
20782025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
20792025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
20802025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
20812025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
20822025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "95355596-71cf-4626-8dee-b4657d231e0b", "content-length": "81", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20832025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
20842025-07-01T00:16:54.204ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
20852025-07-01T00:16:54.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
20862025-07-01T00:16:54.206ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
20872025-07-01T00:16:54.206ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
20882025-07-01T00:16:54.206ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
20892025-07-01T00:16:54.206ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
20902025-07-01T00:16:54.206ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "28e4087a-83a8-46d9-ade5-cc1bf8b654f6", "content-length": "81", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20912025-07-01T00:16:54.206ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "53ee1192-5455-4988-b50b-5a780221c1cf", "content-length": "81", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
20922025-07-01T00:16:54.208ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 295.387622ms iteration = 12 status = {"errors":[],"sps":[]}
20932025-07-01T00:16:54.222ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.190048ms iteration = 12 status = {}
20942025-07-01T00:16:54.273ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20952025-07-01T00:16:54.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20962025-07-01T00:16:54.276ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.821945ms iteration = 12 status = null
20972025-07-01T00:16:54.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20982025-07-01T00:16:54.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20992025-07-01T00:16:54.311ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
21002025-07-01T00:16:54.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21012025-07-01T00:16:54.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21022025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
21032025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
21042025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21052025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21062025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21072025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21082025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21092025-07-01T00:16:54.328ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21102025-07-01T00:16:54.329ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21112025-07-01T00:16:54.329ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21122025-07-01T00:16:54.329ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
21132025-07-01T00:16:54.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21142025-07-01T00:16:54.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21152025-07-01T00:16:54.331ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
21162025-07-01T00:16:54.331ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21172025-07-01T00:16:54.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d7db7151-f9ac-4ee4-8a97-aa97060d0dd1", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
21182025-07-01T00:16:54.436ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
21192025-07-01T00:16:54.436ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21202025-07-01T00:16:54.442ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f612dfe-edc6-4e7e-b49a-dad65f4898e0", "content-length": "682", "date": "Tue, 01 Jul 2025 00:16:54 GMT"} })
21212025-07-01T00:16:54.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21222025-07-01T00:16:54.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21232025-07-01T00:16:54.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21242025-07-01T00:16:54.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21252025-07-01T00:16:54.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21262025-07-01T00:16:54.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21272025-07-01T00:16:54.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21282025-07-01T00:16:54.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21292025-07-01T00:16:54.458ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.022955ms iteration = 12 status = {}
21302025-07-01T00:16:54.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef8df705-67d8-4deb-ac3a-caa1025fde48 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21312025-07-01T00:16:54.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef8df705-67d8-4deb-ac3a-caa1025fde48 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21322025-07-01T00:16:54.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef8df705-67d8-4deb-ac3a-caa1025fde48 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21332025-07-01T00:16:54.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 555 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 2ab52c0e-021a-4dcc-9904-16a24c067d8d response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
21342025-07-01T00:16:55.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b658f5ec-17e0-413b-be87-24c77a48caaa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21352025-07-01T00:16:55.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b658f5ec-17e0-413b-be87-24c77a48caaa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21362025-07-01T00:16:55.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1629 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b658f5ec-17e0-413b-be87-24c77a48caaa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21372025-07-01T00:16:56.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc122331-fcf3-4d21-8dc0-49e2536bc71d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21382025-07-01T00:16:56.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc122331-fcf3-4d21-8dc0-49e2536bc71d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21392025-07-01T00:16:56.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc122331-fcf3-4d21-8dc0-49e2536bc71d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21402025-07-01T00:16:57.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 66a77ded-ba27-4738-8495-8819eb7a44d7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21412025-07-01T00:16:57.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 66a77ded-ba27-4738-8495-8819eb7a44d7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21422025-07-01T00:16:57.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1666 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 66a77ded-ba27-4738-8495-8819eb7a44d7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21432025-07-01T00:16:58.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1a3001fe-78fb-48ae-813c-5d05e8b37976 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21442025-07-01T00:16:58.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1a3001fe-78fb-48ae-813c-5d05e8b37976 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21452025-07-01T00:16:58.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1751 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1a3001fe-78fb-48ae-813c-5d05e8b37976 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21462025-07-01T00:16:59.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1cfa71d2-880e-45c8-a06f-1a545d6fd443 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21472025-07-01T00:16:59.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1cfa71d2-880e-45c8-a06f-1a545d6fd443 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21482025-07-01T00:16:59.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1cfa71d2-880e-45c8-a06f-1a545d6fd443 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21492025-07-01T00:17:00.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b6ed9069-9256-4ec6-9ac2-ddc54a38d53d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21502025-07-01T00:17:00.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b6ed9069-9256-4ec6-9ac2-ddc54a38d53d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21512025-07-01T00:17:00.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b6ed9069-9256-4ec6-9ac2-ddc54a38d53d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21522025-07-01T00:17:01.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88270a4c-4b01-469f-ad56-10fe1541ccdb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21532025-07-01T00:17:01.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88270a4c-4b01-469f-ad56-10fe1541ccdb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21542025-07-01T00:17:01.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88270a4c-4b01-469f-ad56-10fe1541ccdb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21552025-07-01T00:17:02.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e62107d5-13f9-40ab-ad06-498838522ebd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21562025-07-01T00:17:02.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e62107d5-13f9-40ab-ad06-498838522ebd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21572025-07-01T00:17:02.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e62107d5-13f9-40ab-ad06-498838522ebd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21582025-07-01T00:17:03.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 68dfd60e-7490-4e53-b400-1993112245c8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21592025-07-01T00:17:03.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 68dfd60e-7490-4e53-b400-1993112245c8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21602025-07-01T00:17:03.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 68dfd60e-7490-4e53-b400-1993112245c8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21612025-07-01T00:17:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
21622025-07-01T00:17:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
21632025-07-01T00:17:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21642025-07-01T00:17:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652025-07-01T00:17:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21662025-07-01T00:17:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21672025-07-01T00:17:03.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21682025-07-01T00:17:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21692025-07-01T00:17:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21702025-07-01T00:17:03.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.476105ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21712025-07-01T00:17:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21722025-07-01T00:17:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21732025-07-01T00:17:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21742025-07-01T00:17:03.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21752025-07-01T00:17:03.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21762025-07-01T00:17:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21772025-07-01T00:17:03.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
21782025-07-01T00:17:03.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21792025-07-01T00:17:03.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21802025-07-01T00:17:03.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
21812025-07-01T00:17:03.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.893197ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
21822025-07-01T00:17:04.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f7083025-365c-44c0-a0f2-b3a4d84f2e3c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21832025-07-01T00:17:04.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f7083025-365c-44c0-a0f2-b3a4d84f2e3c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21842025-07-01T00:17:04.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f7083025-365c-44c0-a0f2-b3a4d84f2e3c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21852025-07-01T00:17:04.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 471 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 8762d6e9-f542-47e7-8b6e-f2c147d07449 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
21862025-07-01T00:17:05.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d4126966-22ed-4624-9b7d-4781666d905b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21872025-07-01T00:17:05.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d4126966-22ed-4624-9b7d-4781666d905b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21882025-07-01T00:17:05.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d4126966-22ed-4624-9b7d-4781666d905b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21892025-07-01T00:17:06.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f03030e9-8ccb-4132-bac5-87b255d33fcf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21902025-07-01T00:17:06.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f03030e9-8ccb-4132-bac5-87b255d33fcf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21912025-07-01T00:17:06.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f03030e9-8ccb-4132-bac5-87b255d33fcf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21922025-07-01T00:17:07.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e709b9e7-6197-4ac5-8b0f-d9f3588b7ed2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21932025-07-01T00:17:07.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e709b9e7-6197-4ac5-8b0f-d9f3588b7ed2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21942025-07-01T00:17:07.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e709b9e7-6197-4ac5-8b0f-d9f3588b7ed2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21952025-07-01T00:17:08.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b3e39240-39fe-4a57-a259-224d99075776 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21962025-07-01T00:17:08.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b3e39240-39fe-4a57-a259-224d99075776 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21972025-07-01T00:17:08.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b3e39240-39fe-4a57-a259-224d99075776 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21982025-07-01T00:17:09.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 97759bea-f287-4259-9ae9-1f0a4bfb230d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
21992025-07-01T00:17:09.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 97759bea-f287-4259-9ae9-1f0a4bfb230d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22002025-07-01T00:17:09.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 97759bea-f287-4259-9ae9-1f0a4bfb230d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22012025-07-01T00:17:10.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27b43728-9832-4979-86dd-117b0e5db80c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22022025-07-01T00:17:10.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27b43728-9832-4979-86dd-117b0e5db80c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22032025-07-01T00:17:10.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27b43728-9832-4979-86dd-117b0e5db80c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22042025-07-01T00:17:11.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9dcada3-dc69-4673-8e5f-37457d843836 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22052025-07-01T00:17:11.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9dcada3-dc69-4673-8e5f-37457d843836 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22062025-07-01T00:17:11.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9dcada3-dc69-4673-8e5f-37457d843836 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22072025-07-01T00:17:12.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c9b9c6c7-6a1b-459a-b755-a60165d3afce roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22082025-07-01T00:17:12.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c9b9c6c7-6a1b-459a-b755-a60165d3afce resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22092025-07-01T00:17:12.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c9b9c6c7-6a1b-459a-b755-a60165d3afce response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22102025-07-01T00:17:13.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5751a81a-ae6b-4092-9e25-05abe3c75552 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22112025-07-01T00:17:13.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5751a81a-ae6b-4092-9e25-05abe3c75552 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22122025-07-01T00:17:13.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
22132025-07-01T00:17:13.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
22142025-07-01T00:17:13.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22152025-07-01T00:17:13.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22162025-07-01T00:17:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22172025-07-01T00:17:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22182025-07-01T00:17:13.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5751a81a-ae6b-4092-9e25-05abe3c75552 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22192025-07-01T00:17:13.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22202025-07-01T00:17:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22212025-07-01T00:17:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22222025-07-01T00:17:13.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.162105ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22232025-07-01T00:17:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22242025-07-01T00:17:13.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22252025-07-01T00:17:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22262025-07-01T00:17:13.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22272025-07-01T00:17:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22282025-07-01T00:17:13.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292025-07-01T00:17:13.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
22302025-07-01T00:17:13.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22312025-07-01T00:17:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22322025-07-01T00:17:13.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
22332025-07-01T00:17:13.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.100647ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
22342025-07-01T00:17:14.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9f98a5bf-42bf-4223-a2d8-4728e35f7339 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22352025-07-01T00:17:14.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9f98a5bf-42bf-4223-a2d8-4728e35f7339 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22362025-07-01T00:17:14.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9f98a5bf-42bf-4223-a2d8-4728e35f7339 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22372025-07-01T00:17:14.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 432 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 1321651c-eaf3-4cbc-add3-c7dec2ecf633 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
22382025-07-01T00:17:15.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bb4baf38-9dce-4200-b32d-55c30cef601e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22392025-07-01T00:17:15.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bb4baf38-9dce-4200-b32d-55c30cef601e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22402025-07-01T00:17:15.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bb4baf38-9dce-4200-b32d-55c30cef601e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22412025-07-01T00:17:16.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53f2cc5d-e524-434d-8158-042553585046 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22422025-07-01T00:17:16.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53f2cc5d-e524-434d-8158-042553585046 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22432025-07-01T00:17:16.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53f2cc5d-e524-434d-8158-042553585046 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22442025-07-01T00:17:17.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef800f1e-0388-454b-a9e4-594bd9fd29d2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22452025-07-01T00:17:17.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef800f1e-0388-454b-a9e4-594bd9fd29d2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22462025-07-01T00:17:17.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef800f1e-0388-454b-a9e4-594bd9fd29d2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22472025-07-01T00:17:18.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ea97d2b-a08e-4950-9c90-6fa1d0c6cf3b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22482025-07-01T00:17:18.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ea97d2b-a08e-4950-9c90-6fa1d0c6cf3b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22492025-07-01T00:17:18.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ea97d2b-a08e-4950-9c90-6fa1d0c6cf3b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22502025-07-01T00:17:19.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 14604e25-60a5-4d8e-85d7-7e2bbd3e224d roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
22512025-07-01T00:17:19.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 14604e25-60a5-4d8e-85d7-7e2bbd3e224d resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
22522025-07-01T00:17:19.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3046 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 14604e25-60a5-4d8e-85d7-7e2bbd3e224d response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
22532025-07-01T00:17:19.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = cd02df66-7532-4748-9244-767412b0f84b roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
22542025-07-01T00:17:19.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = cd02df66-7532-4748-9244-767412b0f84b resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
22552025-07-01T00:17:19.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = cd02df66-7532-4748-9244-767412b0f84b response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
22562025-07-01T00:17:19.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 52b4db14-034c-423d-84d6-a6bc212e9aa3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22572025-07-01T00:17:19.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 52b4db14-034c-423d-84d6-a6bc212e9aa3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22582025-07-01T00:17:19.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 52b4db14-034c-423d-84d6-a6bc212e9aa3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22592025-07-01T00:17:21.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 613a36ca-8f3a-48cf-88ea-f9e69ff69b61 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22602025-07-01T00:17:21.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 613a36ca-8f3a-48cf-88ea-f9e69ff69b61 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22612025-07-01T00:17:21.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 613a36ca-8f3a-48cf-88ea-f9e69ff69b61 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22622025-07-01T00:17:22.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a0b6d40-39ea-4d9a-bc91-cf82de4ba98b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22632025-07-01T00:17:22.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a0b6d40-39ea-4d9a-bc91-cf82de4ba98b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22642025-07-01T00:17:22.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a0b6d40-39ea-4d9a-bc91-cf82de4ba98b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22652025-07-01T00:17:23.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 170a62e3-a1f5-468b-a8ec-fa2fc4a8d20d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22662025-07-01T00:17:23.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 170a62e3-a1f5-468b-a8ec-fa2fc4a8d20d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22672025-07-01T00:17:23.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 170a62e3-a1f5-468b-a8ec-fa2fc4a8d20d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
22682025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
22692025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
22702025-07-01T00:17:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
22712025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.601\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
22722025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
22732025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22742025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
22752025-07-01T00:17:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:07:23.901146993 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22762025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22772025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
22782025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
22792025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22802025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22812025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
22822025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
22832025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22842025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
22852025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22862025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22872025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
22882025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22892025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
22902025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
22912025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22922025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22932025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22942025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22952025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22962025-07-01T00:17:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1373, tv_nsec: 727261113 } })
22972025-07-01T00:17:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1373, tv_nsec: 727297714 } })
22982025-07-01T00:17:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22992025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23002025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 951.696\u{b5}s iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23012025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23022025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.071859ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23032025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
23042025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
23052025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
23062025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23072025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23082025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
23092025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23102025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23112025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23122025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
23132025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23142025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
23152025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23162025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
23172025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23182025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
23192025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23202025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
23212025-07-01T00:17:23.902ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
23222025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23232025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 10 reason = Timeout
23242025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
23252025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 7.171\u{b5}s iteration = 10 status = "Disabled"
23262025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
23272025-07-01T00:17:23.902ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23282025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
23292025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23302025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23312025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
23322025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23332025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
23342025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23352025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
23362025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
23372025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23382025-07-01T00:17:23.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23392025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23402025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23412025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23422025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23432025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23442025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23452025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23462025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23472025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23482025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23492025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23502025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23512025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23522025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23532025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23542025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23552025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23562025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23572025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23582025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23592025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23602025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23612025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23622025-07-01T00:17:23.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23632025-07-01T00:17:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23642025-07-01T00:17:23.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652025-07-01T00:17:23.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:07:23.901146993 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23662025-07-01T00:17:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.573268ms iteration = 7 status = {"expiration":"2025-07-01T00:07:23.901146993Z","pruned":[]}
23672025-07-01T00:17:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.481036ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23682025-07-01T00:17:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23692025-07-01T00:17:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23702025-07-01T00:17:23.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1373, tv_nsec: 731015566 } })
23712025-07-01T00:17:23.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
23722025-07-01T00:17:23.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23732025-07-01T00:17:23.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23742025-07-01T00:17:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1373, tv_nsec: 732012553 } })
23752025-07-01T00:17:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23762025-07-01T00:17:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
23772025-07-01T00:17:23.908ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782025-07-01T00:17:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23792025-07-01T00:17:23.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802025-07-01T00:17:23.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23822025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23832025-07-01T00:17:23.911ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23842025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.584485ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23852025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23862025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23872025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23882025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23892025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23902025-07-01T00:17:23.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23912025-07-01T00:17:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23922025-07-01T00:17:23.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23932025-07-01T00:17:23.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23942025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
23962025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
23972025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23982025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23992025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 7 reason = Timeout
24002025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
24012025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
24022025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
24032025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 7 reason = Timeout
24042025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
24052025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
24062025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24072025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
24082025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24092025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 13 reason = Timeout
24102025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
24112025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24122025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
24132025-07-01T00:17:23.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1373, tv_nsec: 739032885 } })
24142025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
24152025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24162025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24172025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24182025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24192025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24202025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
24212025-07-01T00:17:23.913ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24222025-07-01T00:17:23.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24232025-07-01T00:17:23.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24242025-07-01T00:17:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24252025-07-01T00:17:23.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24262025-07-01T00:17:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24272025-07-01T00:17:23.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24282025-07-01T00:17:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24292025-07-01T00:17:23.916ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24302025-07-01T00:17:23.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24312025-07-01T00:17:23.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24322025-07-01T00:17:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24332025-07-01T00:17:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24342025-07-01T00:17:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24352025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24362025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24372025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24382025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24392025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24402025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24412025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24422025-07-01T00:17:23.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24432025-07-01T00:17:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24442025-07-01T00:17:23.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24452025-07-01T00:17:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24462025-07-01T00:17:23.919ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24472025-07-01T00:17:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24482025-07-01T00:17:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24492025-07-01T00:17:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24502025-07-01T00:17:23.920ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24512025-07-01T00:17:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24522025-07-01T00:17:23.920ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532025-07-01T00:17:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24542025-07-01T00:17:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24552025-07-01T00:17:23.925ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24562025-07-01T00:17:23.925ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24572025-07-01T00:17:23.925ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24582025-07-01T00:17:23.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24592025-07-01T00:17:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24602025-07-01T00:17:23.926ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24612025-07-01T00:17:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24622025-07-01T00:17:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24632025-07-01T00:17:23.926ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642025-07-01T00:17:23.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24652025-07-01T00:17:23.929ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24662025-07-01T00:17:23.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24672025-07-01T00:17:23.929ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24682025-07-01T00:17:23.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24692025-07-01T00:17:23.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24702025-07-01T00:17:23.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24712025-07-01T00:17:23.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.565892ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
24722025-07-01T00:17:23.933ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.927093ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
24732025-07-01T00:17:23.935ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24742025-07-01T00:17:23.935ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.732506ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24752025-07-01T00:17:23.936ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 23.02304ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
24762025-07-01T00:17:23.936ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
24772025-07-01T00:17:23.936ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 23.061211ms iteration = 7 status = {"by_rx":{},"error":null}
24782025-07-01T00:17:23.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24792025-07-01T00:17:23.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24802025-07-01T00:17:23.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24812025-07-01T00:17:23.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24822025-07-01T00:17:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24832025-07-01T00:17:23.939ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1373, tv_nsec: 764688887 } })
24842025-07-01T00:17:23.939ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
24852025-07-01T00:17:23.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24862025-07-01T00:17:23.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24872025-07-01T00:17:23.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24882025-07-01T00:17:23.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24892025-07-01T00:17:23.941ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24902025-07-01T00:17:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24912025-07-01T00:17:23.942ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 39.650475ms iteration = 4 status = {"nsuccess":5}
24922025-07-01T00:17:23.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24932025-07-01T00:17:23.944ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
24942025-07-01T00:17:23.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
24952025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24962025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24972025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24982025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24992025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25002025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25012025-07-01T00:17:23.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022025-07-01T00:17:23.950ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 37.392614ms iteration = 7 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
25032025-07-01T00:17:23.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
25042025-07-01T00:17:23.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25052025-07-01T00:17:23.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25062025-07-01T00:17:23.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25072025-07-01T00:17:23.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25082025-07-01T00:17:23.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.323383ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25092025-07-01T00:17:23.959ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25102025-07-01T00:17:23.959ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25112025-07-01T00:17:23.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25122025-07-01T00:17:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25132025-07-01T00:17:23.964ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25142025-07-01T00:17:23.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25152025-07-01T00:17:23.965ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
25162025-07-01T00:17:23.965ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.424118ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
25172025-07-01T00:17:23.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.280391ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25182025-07-01T00:17:23.971ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25192025-07-01T00:17:23.971ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25202025-07-01T00:17:23.971ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25212025-07-01T00:17:23.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25222025-07-01T00:17:23.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25232025-07-01T00:17:23.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242025-07-01T00:17:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25252025-07-01T00:17:23.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25262025-07-01T00:17:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25272025-07-01T00:17:23.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.074589ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
25282025-07-01T00:17:23.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25292025-07-01T00:17:23.993ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25302025-07-01T00:17:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25312025-07-01T00:17:23.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25322025-07-01T00:17:23.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25332025-07-01T00:17:23.995ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25342025-07-01T00:17:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25352025-07-01T00:17:23.995ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25362025-07-01T00:17:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25372025-07-01T00:17:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25382025-07-01T00:17:23.996ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25392025-07-01T00:17:23.996ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
25402025-07-01T00:17:23.996ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.742265ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25412025-07-01T00:17:23.998ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25422025-07-01T00:17:23.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25432025-07-01T00:17:24.000ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442025-07-01T00:17:24.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25452025-07-01T00:17:24.003ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25462025-07-01T00:17:24.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25472025-07-01T00:17:24.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25482025-07-01T00:17:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25492025-07-01T00:17:24.004ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25502025-07-01T00:17:24.004ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25512025-07-01T00:17:24.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25522025-07-01T00:17:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25532025-07-01T00:17:24.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25542025-07-01T00:17:24.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552025-07-01T00:17:24.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25562025-07-01T00:17:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25572025-07-01T00:17:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25582025-07-01T00:17:24.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25592025-07-01T00:17:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25602025-07-01T00:17:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
25612025-07-01T00:17:24.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25622025-07-01T00:17:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25632025-07-01T00:17:24.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642025-07-01T00:17:24.012ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25652025-07-01T00:17:24.012ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25662025-07-01T00:17:24.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25672025-07-01T00:17:24.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25682025-07-01T00:17:24.013ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.562035ms iteration = 13 status = 0
25692025-07-01T00:17:24.013ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
25702025-07-01T00:17:24.013ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25712025-07-01T00:17:24.013ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
25722025-07-01T00:17:24.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 112.21781ms iteration = 7 status = {"generation":1}
25732025-07-01T00:17:24.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25742025-07-01T00:17:24.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25752025-07-01T00:17:24.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25762025-07-01T00:17:24.031ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25772025-07-01T00:17:24.031ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
25782025-07-01T00:17:24.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25792025-07-01T00:17:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25802025-07-01T00:17:24.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812025-07-01T00:17:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25822025-07-01T00:17:24.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25832025-07-01T00:17:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25842025-07-01T00:17:24.039ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
25852025-07-01T00:17:24.039ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25862025-07-01T00:17:24.039ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
25872025-07-01T00:17:24.039ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.401077ms iteration = 7 status = {"generation":2}
25882025-07-01T00:17:24.046ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
25892025-07-01T00:17:24.046ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 143.775824ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
25902025-07-01T00:17:24.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25912025-07-01T00:17:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25922025-07-01T00:17:24.054ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25932025-07-01T00:17:24.054ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25942025-07-01T00:17:24.054ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.673609ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25952025-07-01T00:17:24.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.611592ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25962025-07-01T00:17:24.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 142.710434ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25972025-07-01T00:17:24.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25982025-07-01T00:17:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25992025-07-01T00:17:24.063ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
26002025-07-01T00:17:24.063ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 160.767379ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26012025-07-01T00:17:24.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa89db9a-5799-4a89-ae90-169057a5e3f5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
26022025-07-01T00:17:24.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa89db9a-5799-4a89-ae90-169057a5e3f5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
26032025-07-01T00:17:24.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2594 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa89db9a-5799-4a89-ae90-169057a5e3f5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
26042025-07-01T00:17:24.076ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
26052025-07-01T00:17:24.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26062025-07-01T00:17:24.076ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26072025-07-01T00:17:24.076ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80fb22b1-51a8-494b-921a-bf85af178e54", "content-length": "26", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26082025-07-01T00:17:24.076ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26092025-07-01T00:17:24.078ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26102025-07-01T00:17:24.082ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
26112025-07-01T00:17:24.082ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 181.110424ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26122025-07-01T00:17:24.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26132025-07-01T00:17:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26142025-07-01T00:17:24.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152025-07-01T00:17:24.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26162025-07-01T00:17:24.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26172025-07-01T00:17:24.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26182025-07-01T00:17:24.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26192025-07-01T00:17:24.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26202025-07-01T00:17:24.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26212025-07-01T00:17:24.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26222025-07-01T00:17:24.101ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26232025-07-01T00:17:24.104ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.175874ms iteration = 15 status = {"physical_disks_added":0}
26242025-07-01T00:17:24.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
26252025-07-01T00:17:24.147ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26262025-07-01T00:17:24.147ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b0794ba-861d-463d-981e-627704f85504", "content-length": "26", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26272025-07-01T00:17:24.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26282025-07-01T00:17:24.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
26292025-07-01T00:17:24.231ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26302025-07-01T00:17:24.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26312025-07-01T00:17:24.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0f16e72-c489-48ad-958c-3928a753b7d4", "content-length": "372", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26322025-07-01T00:17:24.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26332025-07-01T00:17:24.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26342025-07-01T00:17:24.248ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26352025-07-01T00:17:24.248ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26362025-07-01T00:17:24.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c028a274-de01-4c6e-b845-d3d73d76dd0f", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26372025-07-01T00:17:24.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26382025-07-01T00:17:24.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26392025-07-01T00:17:24.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26402025-07-01T00:17:24.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26412025-07-01T00:17:24.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26422025-07-01T00:17:24.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26432025-07-01T00:17:24.259ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26442025-07-01T00:17:24.259ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26452025-07-01T00:17:24.259ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6cac05bb-aa3d-43d5-8372-8b48ef5e6094", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26462025-07-01T00:17:24.262ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.549777ms iteration = 13 status = {}
26472025-07-01T00:17:24.263ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
26482025-07-01T00:17:24.263ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26492025-07-01T00:17:24.263ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3062763e-7e08-4d95-96be-d20a13ad7775", "content-length": "26", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26502025-07-01T00:17:24.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26512025-07-01T00:17:24.264ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
26522025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "248df5a8-77ea-4a23-978a-40c17f6ddb2d", "content-length": "78", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26532025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
26542025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
26552025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
26562025-07-01T00:17:24.265ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26572025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
26582025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
26592025-07-01T00:17:24.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
26602025-07-01T00:17:24.266ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
26612025-07-01T00:17:24.266ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
26622025-07-01T00:17:24.268ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
26632025-07-01T00:17:24.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
26642025-07-01T00:17:24.269ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
26652025-07-01T00:17:24.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
26662025-07-01T00:17:24.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
26672025-07-01T00:17:24.270ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
26682025-07-01T00:17:24.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
26692025-07-01T00:17:24.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
26702025-07-01T00:17:24.271ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
26712025-07-01T00:17:24.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
26722025-07-01T00:17:24.271ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
26732025-07-01T00:17:24.271ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
26742025-07-01T00:17:24.272ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e91367d-689a-4d12-ba80-c43875a4c315", "content-length": "81", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26752025-07-01T00:17:24.290ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26762025-07-01T00:17:24.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26772025-07-01T00:17:24.303ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3081312a-6f68-483a-9ef8-7b7dfd5d9c7f", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26782025-07-01T00:17:24.303ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26792025-07-01T00:17:24.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "301ec403-aef8-4c7e-b1d7-ddecdb294219", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26802025-07-01T00:17:24.306ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26812025-07-01T00:17:24.308ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26822025-07-01T00:17:24.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 407.696915ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26832025-07-01T00:17:24.310ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 408.773204ms iteration = 13 status = {}
26842025-07-01T00:17:24.312ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
26852025-07-01T00:17:24.312ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
26862025-07-01T00:17:24.313ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3a96bf5-ce51-4a3e-adf2-793aadf54e81", "content-length": "81", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26872025-07-01T00:17:24.315ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
26882025-07-01T00:17:24.315ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
26892025-07-01T00:17:24.315ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0984b40a-8b54-4c2a-bbfc-569a9014e079", "content-length": "81", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
26902025-07-01T00:17:24.317ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 404.715793ms iteration = 13 status = {"errors":[],"sps":[]}
26912025-07-01T00:17:24.421ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26922025-07-01T00:17:24.422ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "50e8a3f3-a698-4ff9-9dd7-bab7c5e4c58a", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26932025-07-01T00:17:24.422ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26942025-07-01T00:17:24.424ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "44c08f3c-6809-48b2-a792-e0538700b066", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26952025-07-01T00:17:24.424ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26962025-07-01T00:17:24.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "db53dec1-d179-495b-ada9-f8f25cd0a2ef", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26972025-07-01T00:17:24.426ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26982025-07-01T00:17:24.428ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26992025-07-01T00:17:24.428ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 526.820183ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27002025-07-01T00:17:24.488ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27012025-07-01T00:17:24.488ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "749a6ebb-89e4-4627-964b-39b4ff4d0612", "content-length": "691", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
27022025-07-01T00:17:24.488ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27032025-07-01T00:17:24.488ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27042025-07-01T00:17:24.488ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27052025-07-01T00:17:24.490ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 588.004037ms iteration = 13 status = {}
27062025-07-01T00:17:24.499ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27072025-07-01T00:17:24.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27082025-07-01T00:17:24.502ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 600.876ms iteration = 13 status = null
27092025-07-01T00:17:24.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27102025-07-01T00:17:24.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27112025-07-01T00:17:24.522ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
27122025-07-01T00:17:24.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27132025-07-01T00:17:24.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27142025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
27152025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
27162025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27172025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27182025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27192025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27202025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27212025-07-01T00:17:24.536ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27222025-07-01T00:17:24.537ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27232025-07-01T00:17:24.537ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27242025-07-01T00:17:24.537ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
27252025-07-01T00:17:24.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27262025-07-01T00:17:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27272025-07-01T00:17:24.540ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
27282025-07-01T00:17:24.540ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27292025-07-01T00:17:24.641ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "12cac6c8-9931-4f40-bca1-9fd686e83306", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
27302025-07-01T00:17:24.641ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
27312025-07-01T00:17:24.641ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27322025-07-01T00:17:24.641ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dce2300-aab6-4978-ac1f-a429ac5afd5a", "content-length": "682", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
27332025-07-01T00:17:24.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27342025-07-01T00:17:24.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27352025-07-01T00:17:24.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27362025-07-01T00:17:24.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27372025-07-01T00:17:24.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27382025-07-01T00:17:24.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27392025-07-01T00:17:24.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27402025-07-01T00:17:24.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27412025-07-01T00:17:24.658ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 755.744537ms iteration = 13 status = {}
27422025-07-01T00:17:24.661ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 2
27432025-07-01T00:17:24.661ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
27442025-07-01T00:17:24.692ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
27452025-07-01T00:17:24.692ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:64937
27462025-07-01T00:17:24.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:64937 req_id = 2dbaefb1-992a-49c3-b7b0-a75585929004 roles = RoleSet { roles: {} } uri = /metrics/producers
27472025-07-01T00:17:24.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:64937 req_id = 2dbaefb1-992a-49c3-b7b0-a75585929004 resource = Database result = Ok(()) uri = /metrics/producers
27482025-07-01T00:17:24.738ZINFOnexus: assigned collector to new producer collector_id = a8a4439d-9bed-4df3-9921-c50bfb72fc42 file = nexus/src/app/oximeter.rs:76 producer_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
27492025-07-01T00:17:24.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 46696 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:64937 req_id = 2dbaefb1-992a-49c3-b7b0-a75585929004 response_code = 201 uri = /metrics/producers
27502025-07-01T00:17:24.738ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2dbaefb1-992a-49c3-b7b0-a75585929004", "content-length": "41", "date": "Tue, 01 Jul 2025 00:17:24 GMT"} })
27512025-07-01T00:17:24.739ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
27522025-07-01T00:17:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 568 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = a744d38b-e1f7-4b2f-8f41-09545ceef42d response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
27532025-07-01T00:17:25.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 998d3f31-9e42-44ec-8fd7-ba6be6d612b4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27542025-07-01T00:17:25.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 998d3f31-9e42-44ec-8fd7-ba6be6d612b4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27552025-07-01T00:17:25.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 998d3f31-9e42-44ec-8fd7-ba6be6d612b4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27562025-07-01T00:17:26.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 429cd38a-c35b-4183-835d-3d02e02654ef roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27572025-07-01T00:17:26.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 429cd38a-c35b-4183-835d-3d02e02654ef resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27582025-07-01T00:17:26.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2896 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 429cd38a-c35b-4183-835d-3d02e02654ef response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27592025-07-01T00:17:27.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b6e3ca40-b703-40ca-8157-bdcf32be519e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27602025-07-01T00:17:27.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b6e3ca40-b703-40ca-8157-bdcf32be519e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27612025-07-01T00:17:27.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b6e3ca40-b703-40ca-8157-bdcf32be519e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27622025-07-01T00:17:28.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eb095741-30f0-4056-8266-3380db722a24 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27632025-07-01T00:17:28.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eb095741-30f0-4056-8266-3380db722a24 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27642025-07-01T00:17:28.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = eb095741-30f0-4056-8266-3380db722a24 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27652025-07-01T00:17:29.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6dc971f9-77b1-4fc7-bd45-814ff01c192c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27662025-07-01T00:17:29.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6dc971f9-77b1-4fc7-bd45-814ff01c192c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27672025-07-01T00:17:29.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6dc971f9-77b1-4fc7-bd45-814ff01c192c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27682025-07-01T00:17:30.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 732c571a-9bf1-49c4-a6c2-35d544edbb89 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27692025-07-01T00:17:30.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 732c571a-9bf1-49c4-a6c2-35d544edbb89 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27702025-07-01T00:17:30.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 732c571a-9bf1-49c4-a6c2-35d544edbb89 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27712025-07-01T00:17:31.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5b8561dc-4c93-4eb6-a9de-b385475ef417 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27722025-07-01T00:17:31.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5b8561dc-4c93-4eb6-a9de-b385475ef417 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27732025-07-01T00:17:31.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5b8561dc-4c93-4eb6-a9de-b385475ef417 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27742025-07-01T00:17:32.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cad19379-4d1b-48d0-bc01-44071f6fea56 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27752025-07-01T00:17:32.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cad19379-4d1b-48d0-bc01-44071f6fea56 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27762025-07-01T00:17:32.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cad19379-4d1b-48d0-bc01-44071f6fea56 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27772025-07-01T00:17:33.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = af5e9392-9f7d-48a3-986a-e2699bf74eab roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27782025-07-01T00:17:33.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = af5e9392-9f7d-48a3-986a-e2699bf74eab resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27792025-07-01T00:17:33.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = af5e9392-9f7d-48a3-986a-e2699bf74eab response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
27802025-07-01T00:17:33.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
27812025-07-01T00:17:33.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27822025-07-01T00:17:33.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
27832025-07-01T00:17:33.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27842025-07-01T00:17:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27852025-07-01T00:17:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27862025-07-01T00:17:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872025-07-01T00:17:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27882025-07-01T00:17:33.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27892025-07-01T00:17:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27902025-07-01T00:17:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27912025-07-01T00:17:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27922025-07-01T00:17:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932025-07-01T00:17:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
27942025-07-01T00:17:33.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27952025-07-01T00:17:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27962025-07-01T00:17:33.929ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
27972025-07-01T00:17:33.929ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.358272ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
27982025-07-01T00:17:33.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27992025-07-01T00:17:33.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28002025-07-01T00:17:33.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.178128ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28012025-07-01T00:17:34.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 11395a43-bb5a-4323-a6f0-cd30af53c1b2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28022025-07-01T00:17:34.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 11395a43-bb5a-4323-a6f0-cd30af53c1b2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28032025-07-01T00:17:34.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 11395a43-bb5a-4323-a6f0-cd30af53c1b2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28042025-07-01T00:17:34.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = dcd2ad43-1481-4271-8b2a-a93c15d452c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
28052025-07-01T00:17:34.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = dcd2ad43-1481-4271-8b2a-a93c15d452c6 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
28062025-07-01T00:17:34.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2955 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = dcd2ad43-1481-4271-8b2a-a93c15d452c6 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
28072025-07-01T00:17:34.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 616fc495-52da-4ad3-9302-b2dde379737b roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
28082025-07-01T00:17:34.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 616fc495-52da-4ad3-9302-b2dde379737b resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
28092025-07-01T00:17:34.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 616fc495-52da-4ad3-9302-b2dde379737b response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
28102025-07-01T00:17:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 430 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 2a8dc0e9-14e8-4b56-8322-438c0dfea3ac response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
28112025-07-01T00:17:35.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b1e90cba-5fcc-41f8-9f0c-0d0ab45e0fb7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28122025-07-01T00:17:35.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b1e90cba-5fcc-41f8-9f0c-0d0ab45e0fb7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28132025-07-01T00:17:35.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1713 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b1e90cba-5fcc-41f8-9f0c-0d0ab45e0fb7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28142025-07-01T00:17:36.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ca58c306-f5e8-4779-bddd-094345bf5fbe roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28152025-07-01T00:17:36.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ca58c306-f5e8-4779-bddd-094345bf5fbe resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28162025-07-01T00:17:36.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ca58c306-f5e8-4779-bddd-094345bf5fbe response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28172025-07-01T00:17:37.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39393763-6756-493f-b3d8-de8e642e8a17 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28182025-07-01T00:17:37.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39393763-6756-493f-b3d8-de8e642e8a17 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28192025-07-01T00:17:37.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39393763-6756-493f-b3d8-de8e642e8a17 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28202025-07-01T00:17:38.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9dc6be38-4163-4179-951d-4808e7b91168 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28212025-07-01T00:17:38.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9dc6be38-4163-4179-951d-4808e7b91168 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28222025-07-01T00:17:38.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9dc6be38-4163-4179-951d-4808e7b91168 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28232025-07-01T00:17:39.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db945817-50c2-4372-b3c1-40eedbb615a5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28242025-07-01T00:17:39.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db945817-50c2-4372-b3c1-40eedbb615a5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28252025-07-01T00:17:39.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db945817-50c2-4372-b3c1-40eedbb615a5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28262025-07-01T00:17:40.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bc31ca7a-6f3e-4e97-b212-c00f98e6d557 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28272025-07-01T00:17:40.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bc31ca7a-6f3e-4e97-b212-c00f98e6d557 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28282025-07-01T00:17:40.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bc31ca7a-6f3e-4e97-b212-c00f98e6d557 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28292025-07-01T00:17:41.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fb60a618-97cc-43f4-b0d4-3037b08bcd39 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28302025-07-01T00:17:41.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fb60a618-97cc-43f4-b0d4-3037b08bcd39 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28312025-07-01T00:17:41.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fb60a618-97cc-43f4-b0d4-3037b08bcd39 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28322025-07-01T00:17:42.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = adb75445-7728-431e-b8c2-0ed1e0435c01 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28332025-07-01T00:17:42.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = adb75445-7728-431e-b8c2-0ed1e0435c01 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28342025-07-01T00:17:42.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = adb75445-7728-431e-b8c2-0ed1e0435c01 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28352025-07-01T00:17:43.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ed935512-9e99-448a-940f-abeba1b2c541 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28362025-07-01T00:17:43.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ed935512-9e99-448a-940f-abeba1b2c541 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28372025-07-01T00:17:43.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ed935512-9e99-448a-940f-abeba1b2c541 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28382025-07-01T00:17:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
28392025-07-01T00:17:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
28402025-07-01T00:17:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28412025-07-01T00:17:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28422025-07-01T00:17:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28432025-07-01T00:17:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28442025-07-01T00:17:43.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28452025-07-01T00:17:43.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28462025-07-01T00:17:43.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28472025-07-01T00:17:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.226905ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28482025-07-01T00:17:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28492025-07-01T00:17:43.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28502025-07-01T00:17:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28512025-07-01T00:17:43.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28522025-07-01T00:17:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28532025-07-01T00:17:43.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542025-07-01T00:17:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
28552025-07-01T00:17:43.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28562025-07-01T00:17:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28572025-07-01T00:17:43.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
28582025-07-01T00:17:43.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.183094ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
28592025-07-01T00:17:44.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2165609b-928b-4bc9-8153-83e23e3d81c2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28602025-07-01T00:17:44.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2165609b-928b-4bc9-8153-83e23e3d81c2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28612025-07-01T00:17:44.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2165609b-928b-4bc9-8153-83e23e3d81c2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28622025-07-01T00:17:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 4b016346-9e4c-4079-a809-aef5981ea863 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
28632025-07-01T00:17:45.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 64001f37-7a08-4dc4-996a-f6ef0bd081e1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28642025-07-01T00:17:45.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 64001f37-7a08-4dc4-996a-f6ef0bd081e1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28652025-07-01T00:17:45.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 64001f37-7a08-4dc4-996a-f6ef0bd081e1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28662025-07-01T00:17:46.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef0e7b52-179e-4acd-b7d7-4bdf917d65ad roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28672025-07-01T00:17:46.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef0e7b52-179e-4acd-b7d7-4bdf917d65ad resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28682025-07-01T00:17:46.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef0e7b52-179e-4acd-b7d7-4bdf917d65ad response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28692025-07-01T00:17:47.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01ad39ff-d7d4-4235-95c4-f70d1c0b40d9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28702025-07-01T00:17:47.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01ad39ff-d7d4-4235-95c4-f70d1c0b40d9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28712025-07-01T00:17:47.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01ad39ff-d7d4-4235-95c4-f70d1c0b40d9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28722025-07-01T00:17:48.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c29598e-389d-4d42-962e-e217abd0d788 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28732025-07-01T00:17:48.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c29598e-389d-4d42-962e-e217abd0d788 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28742025-07-01T00:17:48.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c29598e-389d-4d42-962e-e217abd0d788 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28752025-07-01T00:17:49.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c25a6b2e-7100-4480-8ec7-1a7b8d114fd1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28762025-07-01T00:17:49.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c25a6b2e-7100-4480-8ec7-1a7b8d114fd1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28772025-07-01T00:17:49.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c25a6b2e-7100-4480-8ec7-1a7b8d114fd1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28782025-07-01T00:17:50.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2327a4ef-cee0-417a-8c30-ba1655eb17a3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28792025-07-01T00:17:50.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2327a4ef-cee0-417a-8c30-ba1655eb17a3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28802025-07-01T00:17:50.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2327a4ef-cee0-417a-8c30-ba1655eb17a3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28812025-07-01T00:17:51.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1194432c-a3ba-4ec5-ae19-91767305baf6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28822025-07-01T00:17:51.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1194432c-a3ba-4ec5-ae19-91767305baf6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28832025-07-01T00:17:51.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1194432c-a3ba-4ec5-ae19-91767305baf6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28842025-07-01T00:17:52.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 613ccf37-7afe-4c5e-a3ce-295fec4b7197 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28852025-07-01T00:17:52.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 613ccf37-7afe-4c5e-a3ce-295fec4b7197 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28862025-07-01T00:17:52.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 613ccf37-7afe-4c5e-a3ce-295fec4b7197 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28872025-07-01T00:17:53.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e583f0f-7a9a-488f-a252-db2bb2f484ac roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28882025-07-01T00:17:53.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e583f0f-7a9a-488f-a252-db2bb2f484ac resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28892025-07-01T00:17:53.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e583f0f-7a9a-488f-a252-db2bb2f484ac response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
28902025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
28912025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
28922025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
28932025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28942025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28952025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28962025-07-01T00:17:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28972025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
28982025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
28992025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
29002025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29012025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29022025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29032025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
29042025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29052025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
29062025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29072025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
29082025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29092025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
29102025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
29112025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29122025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29132025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
29142025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29152025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29162025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
29172025-07-01T00:17:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29182025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29192025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
29202025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29212025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29222025-07-01T00:17:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29232025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29242025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29252025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29262025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29272025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29282025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29292025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29302025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29312025-07-01T00:17:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29322025-07-01T00:17:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1403, tv_nsec: 730260705 } })
29332025-07-01T00:17:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
29342025-07-01T00:17:53.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1403, tv_nsec: 730744829 } })
29352025-07-01T00:17:53.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362025-07-01T00:17:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
29372025-07-01T00:17:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.340189ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29382025-07-01T00:17:53.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29392025-07-01T00:17:53.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29402025-07-01T00:17:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29412025-07-01T00:17:53.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29422025-07-01T00:17:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29432025-07-01T00:17:53.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29442025-07-01T00:17:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29452025-07-01T00:17:53.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462025-07-01T00:17:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29472025-07-01T00:17:53.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29482025-07-01T00:17:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29492025-07-01T00:17:53.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502025-07-01T00:17:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29512025-07-01T00:17:53.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29522025-07-01T00:17:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29532025-07-01T00:17:53.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29542025-07-01T00:17:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29552025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29562025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29572025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29582025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29592025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29602025-07-01T00:17:53.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1403, tv_nsec: 737959786 } })
29612025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29622025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
29632025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29642025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
29652025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29662025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
29672025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
29682025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
29692025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29702025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 14 reason = Timeout
29712025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
29722025-07-01T00:17:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29732025-07-01T00:17:53.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
29742025-07-01T00:17:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29752025-07-01T00:17:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29762025-07-01T00:17:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29772025-07-01T00:17:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
29782025-07-01T00:17:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1403, tv_nsec: 738760588 } })
29792025-07-01T00:17:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29802025-07-01T00:17:53.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29812025-07-01T00:17:53.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29822025-07-01T00:17:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29832025-07-01T00:17:53.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29842025-07-01T00:17:53.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29852025-07-01T00:17:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29862025-07-01T00:17:53.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29872025-07-01T00:17:53.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29882025-07-01T00:17:53.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29892025-07-01T00:17:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29902025-07-01T00:17:53.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29912025-07-01T00:17:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29922025-07-01T00:17:53.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29932025-07-01T00:17:53.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29942025-07-01T00:17:53.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29952025-07-01T00:17:53.965ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29962025-07-01T00:17:53.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.836972ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29972025-07-01T00:17:53.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29982025-07-01T00:17:53.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29992025-07-01T00:17:53.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30002025-07-01T00:17:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30012025-07-01T00:17:53.966ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30022025-07-01T00:17:53.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30032025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30042025-07-01T00:17:53.967ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30052025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30062025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30072025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.694046ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
30082025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30092025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.793089ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
30102025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.853481ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30112025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
30122025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30132025-07-01T00:17:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30142025-07-01T00:17:53.968ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30152025-07-01T00:17:53.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30162025-07-01T00:17:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30172025-07-01T00:17:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30182025-07-01T00:17:53.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30192025-07-01T00:17:53.969ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30202025-07-01T00:17:53.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30212025-07-01T00:17:53.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222025-07-01T00:17:53.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.379784ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30232025-07-01T00:17:53.971ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30242025-07-01T00:17:53.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30252025-07-01T00:17:53.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30262025-07-01T00:17:53.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272025-07-01T00:17:53.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
30282025-07-01T00:17:53.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30292025-07-01T00:17:53.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30302025-07-01T00:17:53.975ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.713732ms iteration = 14 status = 0
30312025-07-01T00:17:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30322025-07-01T00:17:53.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30332025-07-01T00:17:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30342025-07-01T00:17:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30352025-07-01T00:17:53.975ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30362025-07-01T00:17:53.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30372025-07-01T00:17:53.977ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
30382025-07-01T00:17:53.977ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 73.359777ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30392025-07-01T00:17:53.977ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30402025-07-01T00:17:53.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30412025-07-01T00:17:53.982ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 69.276025ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
30422025-07-01T00:17:53.982ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
30432025-07-01T00:17:53.982ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.489448ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
30442025-07-01T00:17:54.015ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30452025-07-01T00:17:54.015ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30462025-07-01T00:17:54.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30472025-07-01T00:17:54.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30482025-07-01T00:17:54.019ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30492025-07-01T00:17:54.019ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30502025-07-01T00:17:54.019ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.87829ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30512025-07-01T00:17:54.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.167569ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30522025-07-01T00:17:54.022ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.768154ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30532025-07-01T00:17:54.032ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
30542025-07-01T00:17:54.032ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "a211d081-2bac-4f0b-87a0-16d511ff7ce4", "content-length": "78", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
30552025-07-01T00:17:54.032ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
30562025-07-01T00:17:54.032ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
30572025-07-01T00:17:54.032ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
30582025-07-01T00:17:54.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
30592025-07-01T00:17:54.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
30602025-07-01T00:17:54.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
30612025-07-01T00:17:54.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
30622025-07-01T00:17:54.034ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30632025-07-01T00:17:54.034ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46e4935e-77d8-408f-92ec-9fc64d185b1d", "content-length": "26", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
30642025-07-01T00:17:54.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30652025-07-01T00:17:54.035ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
30662025-07-01T00:17:54.035ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
30672025-07-01T00:17:54.035ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
30682025-07-01T00:17:54.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
30692025-07-01T00:17:54.036ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30702025-07-01T00:17:54.036ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28657b78-0288-4b2d-a6a9-a5c7cafe0d5c", "content-length": "26", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
30712025-07-01T00:17:54.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30722025-07-01T00:17:54.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
30732025-07-01T00:17:54.036ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30742025-07-01T00:17:54.036ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d65d86a-e98d-474e-8d11-0f70931ff81f", "content-length": "26", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
30752025-07-01T00:17:54.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30762025-07-01T00:17:54.037ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30772025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
30782025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
30792025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
30802025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
30812025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
30822025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
30832025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
30842025-07-01T00:17:54.038ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
30852025-07-01T00:17:54.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
30862025-07-01T00:17:54.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30872025-07-01T00:17:54.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
30882025-07-01T00:17:54.040ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
30892025-07-01T00:17:54.040ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
30902025-07-01T00:17:54.041ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab9c00d7-2ba8-430f-8407-247a00c09957", "content-length": "81", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
30912025-07-01T00:17:54.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30922025-07-01T00:17:54.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30932025-07-01T00:17:54.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942025-07-01T00:17:54.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30952025-07-01T00:17:54.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30962025-07-01T00:17:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30972025-07-01T00:17:54.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30982025-07-01T00:17:54.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30992025-07-01T00:17:54.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31002025-07-01T00:17:54.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31012025-07-01T00:17:54.073ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
31022025-07-01T00:17:54.074ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
31032025-07-01T00:17:54.074ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "841e807d-ec8b-4338-97c5-cb72a0947190", "content-length": "81", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31042025-07-01T00:17:54.074ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
31052025-07-01T00:17:54.074ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
31062025-07-01T00:17:54.074ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "dec98421-9463-42ed-b25e-d289420e7196", "content-length": "81", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31072025-07-01T00:17:54.076ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 163.201896ms iteration = 14 status = {"errors":[],"sps":[]}
31082025-07-01T00:17:54.093ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.367968ms iteration = 16 status = {"physical_disks_added":0}
31092025-07-01T00:17:54.143ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31102025-07-01T00:17:54.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31112025-07-01T00:17:54.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a4194ce-fa76-4a3b-b1ee-e54bfde512b5", "content-length": "372", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31122025-07-01T00:17:54.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31132025-07-01T00:17:54.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31142025-07-01T00:17:54.192ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31152025-07-01T00:17:54.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31162025-07-01T00:17:54.194ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.953825ms iteration = 14 status = null
31172025-07-01T00:17:54.209ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31182025-07-01T00:17:54.209ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31192025-07-01T00:17:54.209ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bb63f6f8-ce7b-4b03-b167-39f08ca7ccd2", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31202025-07-01T00:17:54.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31212025-07-01T00:17:54.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31222025-07-01T00:17:54.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31232025-07-01T00:17:54.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31242025-07-01T00:17:54.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31252025-07-01T00:17:54.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31262025-07-01T00:17:54.220ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31272025-07-01T00:17:54.220ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31282025-07-01T00:17:54.220ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b091ebd-20fc-41bd-843d-099edb46cc98", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31292025-07-01T00:17:54.222ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.640147ms iteration = 14 status = {}
31302025-07-01T00:17:54.263ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.031555ms iteration = 14 status = {}
31312025-07-01T00:17:54.274ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31322025-07-01T00:17:54.274ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "73e961f2-5b42-44f9-83cf-fdf4e7e77753", "content-length": "691", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31332025-07-01T00:17:54.274ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31342025-07-01T00:17:54.274ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31352025-07-01T00:17:54.274ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31362025-07-01T00:17:54.276ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 372.345257ms iteration = 14 status = {}
31372025-07-01T00:17:54.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31382025-07-01T00:17:54.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31392025-07-01T00:17:54.308ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
31402025-07-01T00:17:54.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31412025-07-01T00:17:54.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31422025-07-01T00:17:54.319ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
31432025-07-01T00:17:54.319ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
31442025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31452025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31462025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31472025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31482025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31492025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31502025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31512025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31522025-07-01T00:17:54.320ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
31532025-07-01T00:17:54.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31542025-07-01T00:17:54.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31552025-07-01T00:17:54.323ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
31562025-07-01T00:17:54.323ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31572025-07-01T00:17:54.426ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08c39760-4a83-4972-93b3-f3cd1af7b161", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31582025-07-01T00:17:54.426ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
31592025-07-01T00:17:54.426ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31602025-07-01T00:17:54.427ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad36658e-8c84-4a0f-a91c-662272ba9386", "content-length": "682", "date": "Tue, 01 Jul 2025 00:17:54 GMT"} })
31612025-07-01T00:17:54.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31622025-07-01T00:17:54.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31632025-07-01T00:17:54.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31642025-07-01T00:17:54.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31652025-07-01T00:17:54.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31662025-07-01T00:17:54.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31672025-07-01T00:17:54.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31682025-07-01T00:17:54.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31692025-07-01T00:17:54.445ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 541.442823ms iteration = 14 status = {}
31702025-07-01T00:17:54.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8a0e4c3-819d-42f0-b928-dbaf0995f3a9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31712025-07-01T00:17:54.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8a0e4c3-819d-42f0-b928-dbaf0995f3a9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31722025-07-01T00:17:54.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8a0e4c3-819d-42f0-b928-dbaf0995f3a9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31732025-07-01T00:17:54.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 042612f5-165a-4379-b7be-2d7bc616e79e response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
31742025-07-01T00:17:55.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7e2d4122-3c99-4a73-beaf-977c14992d7b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31752025-07-01T00:17:55.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7e2d4122-3c99-4a73-beaf-977c14992d7b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31762025-07-01T00:17:55.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7e2d4122-3c99-4a73-beaf-977c14992d7b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31772025-07-01T00:17:56.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f2781e1c-3950-498e-b448-908214cf5bcd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31782025-07-01T00:17:56.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f2781e1c-3950-498e-b448-908214cf5bcd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31792025-07-01T00:17:56.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1819 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f2781e1c-3950-498e-b448-908214cf5bcd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31802025-07-01T00:17:57.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a025be47-10aa-423d-973f-17ff13a48587 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31812025-07-01T00:17:57.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a025be47-10aa-423d-973f-17ff13a48587 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31822025-07-01T00:17:57.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1580 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a025be47-10aa-423d-973f-17ff13a48587 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31832025-07-01T00:17:58.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ec98208e-0a93-416a-95b4-783708d57843 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31842025-07-01T00:17:58.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ec98208e-0a93-416a-95b4-783708d57843 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31852025-07-01T00:17:58.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ec98208e-0a93-416a-95b4-783708d57843 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31862025-07-01T00:17:59.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f6acdfe-1ac8-4a01-a5ed-06b22849715f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31872025-07-01T00:17:59.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f6acdfe-1ac8-4a01-a5ed-06b22849715f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31882025-07-01T00:17:59.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f6acdfe-1ac8-4a01-a5ed-06b22849715f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31892025-07-01T00:18:00.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e454f82-0ced-42d1-b4e6-2b15714f22a0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31902025-07-01T00:18:00.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e454f82-0ced-42d1-b4e6-2b15714f22a0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31912025-07-01T00:18:00.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8e454f82-0ced-42d1-b4e6-2b15714f22a0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31922025-07-01T00:18:01.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa1c4fbc-9e35-4457-831b-d9a74a1f827c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31932025-07-01T00:18:01.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa1c4fbc-9e35-4457-831b-d9a74a1f827c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31942025-07-01T00:18:01.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fa1c4fbc-9e35-4457-831b-d9a74a1f827c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31952025-07-01T00:18:02.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0a9a1f14-de32-47ff-908d-52c291cf6116 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31962025-07-01T00:18:02.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0a9a1f14-de32-47ff-908d-52c291cf6116 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31972025-07-01T00:18:02.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1990 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0a9a1f14-de32-47ff-908d-52c291cf6116 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31982025-07-01T00:18:03.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 10aa3b32-1c0c-4181-af8f-f7a4f5ee6c08 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
31992025-07-01T00:18:03.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 10aa3b32-1c0c-4181-af8f-f7a4f5ee6c08 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32002025-07-01T00:18:03.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 10aa3b32-1c0c-4181-af8f-f7a4f5ee6c08 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32012025-07-01T00:18:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
32022025-07-01T00:18:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32032025-07-01T00:18:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
32042025-07-01T00:18:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32052025-07-01T00:18:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32062025-07-01T00:18:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32072025-07-01T00:18:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082025-07-01T00:18:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32092025-07-01T00:18:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32102025-07-01T00:18:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32112025-07-01T00:18:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32122025-07-01T00:18:03.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32132025-07-01T00:18:03.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142025-07-01T00:18:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
32152025-07-01T00:18:03.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32162025-07-01T00:18:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32172025-07-01T00:18:03.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
32182025-07-01T00:18:03.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.103572ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
32192025-07-01T00:18:03.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32202025-07-01T00:18:03.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32212025-07-01T00:18:03.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.079552ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32222025-07-01T00:18:04.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e8225f61-7680-4fff-95e3-5c76211448ee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32232025-07-01T00:18:04.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e8225f61-7680-4fff-95e3-5c76211448ee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32242025-07-01T00:18:04.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2797 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e8225f61-7680-4fff-95e3-5c76211448ee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32252025-07-01T00:18:04.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 912e1ee8-b9c4-4e5e-8e7b-5423874bfa82 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
32262025-07-01T00:18:04.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 912e1ee8-b9c4-4e5e-8e7b-5423874bfa82 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
32272025-07-01T00:18:04.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3360 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 912e1ee8-b9c4-4e5e-8e7b-5423874bfa82 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
32282025-07-01T00:18:04.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = b9283c68-5a30-4ec4-8117-45c1b556c727 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
32292025-07-01T00:18:04.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = b9283c68-5a30-4ec4-8117-45c1b556c727 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
32302025-07-01T00:18:04.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2609 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = b9283c68-5a30-4ec4-8117-45c1b556c727 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
32312025-07-01T00:18:04.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 6dc1239e-bc58-4d00-afee-adcc94755467 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
32322025-07-01T00:18:05.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c8485ae-9066-44a3-a374-775f8b0bd4ee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32332025-07-01T00:18:05.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c8485ae-9066-44a3-a374-775f8b0bd4ee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32342025-07-01T00:18:05.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1700 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c8485ae-9066-44a3-a374-775f8b0bd4ee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32352025-07-01T00:18:06.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d46c2651-a64b-4a77-9787-0d4d4435bc12 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32362025-07-01T00:18:06.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d46c2651-a64b-4a77-9787-0d4d4435bc12 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32372025-07-01T00:18:06.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d46c2651-a64b-4a77-9787-0d4d4435bc12 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32382025-07-01T00:18:07.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c82aa850-dd8f-489b-8d3d-494b38bece8d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32392025-07-01T00:18:07.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c82aa850-dd8f-489b-8d3d-494b38bece8d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32402025-07-01T00:18:07.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c82aa850-dd8f-489b-8d3d-494b38bece8d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32412025-07-01T00:18:08.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 006b1584-28a6-48d1-bd55-0172ae5c57da roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32422025-07-01T00:18:08.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 006b1584-28a6-48d1-bd55-0172ae5c57da resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32432025-07-01T00:18:08.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 006b1584-28a6-48d1-bd55-0172ae5c57da response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32442025-07-01T00:18:09.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7925a516-c986-4fc8-9ea9-f1698f60f27e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32452025-07-01T00:18:09.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7925a516-c986-4fc8-9ea9-f1698f60f27e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32462025-07-01T00:18:09.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1769 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7925a516-c986-4fc8-9ea9-f1698f60f27e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32472025-07-01T00:18:10.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f117a398-e514-4bd0-af3f-1cdb9844142d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32482025-07-01T00:18:10.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f117a398-e514-4bd0-af3f-1cdb9844142d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32492025-07-01T00:18:10.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f117a398-e514-4bd0-af3f-1cdb9844142d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32502025-07-01T00:18:11.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c85ea848-851e-4776-8406-82b2f74d2789 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32512025-07-01T00:18:11.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c85ea848-851e-4776-8406-82b2f74d2789 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32522025-07-01T00:18:11.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c85ea848-851e-4776-8406-82b2f74d2789 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32532025-07-01T00:18:12.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 78c41132-02bb-4d24-a779-d25399ea49bb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32542025-07-01T00:18:12.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 78c41132-02bb-4d24-a779-d25399ea49bb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32552025-07-01T00:18:12.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 78c41132-02bb-4d24-a779-d25399ea49bb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32562025-07-01T00:18:13.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 005b0574-5adb-4d6c-83dd-85be82342a7e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32572025-07-01T00:18:13.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 005b0574-5adb-4d6c-83dd-85be82342a7e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32582025-07-01T00:18:13.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 005b0574-5adb-4d6c-83dd-85be82342a7e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32592025-07-01T00:18:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
32602025-07-01T00:18:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
32612025-07-01T00:18:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32622025-07-01T00:18:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32632025-07-01T00:18:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32642025-07-01T00:18:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32652025-07-01T00:18:13.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662025-07-01T00:18:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32672025-07-01T00:18:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32682025-07-01T00:18:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.461752ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32692025-07-01T00:18:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32702025-07-01T00:18:13.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32712025-07-01T00:18:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32722025-07-01T00:18:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32732025-07-01T00:18:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32742025-07-01T00:18:13.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32752025-07-01T00:18:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
32762025-07-01T00:18:13.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32772025-07-01T00:18:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32782025-07-01T00:18:13.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
32792025-07-01T00:18:13.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.56038ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
32802025-07-01T00:18:14.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cf11db25-be12-4bf7-b968-d85903f2e9ae roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32812025-07-01T00:18:14.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cf11db25-be12-4bf7-b968-d85903f2e9ae resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32822025-07-01T00:18:14.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cf11db25-be12-4bf7-b968-d85903f2e9ae response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32832025-07-01T00:18:14.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 75fa1ae6-c0c2-4907-b7ea-d53a3224e0b3 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
32842025-07-01T00:18:15.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f584f34f-e33d-4867-974a-a12803948a6f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32852025-07-01T00:18:15.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f584f34f-e33d-4867-974a-a12803948a6f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32862025-07-01T00:18:15.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f584f34f-e33d-4867-974a-a12803948a6f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32872025-07-01T00:18:16.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ff30ae34-7857-44ab-814d-59709c1d2b6a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32882025-07-01T00:18:16.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ff30ae34-7857-44ab-814d-59709c1d2b6a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32892025-07-01T00:18:16.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ff30ae34-7857-44ab-814d-59709c1d2b6a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32902025-07-01T00:18:17.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a6753fda-f362-47a8-be23-7f05d8406fee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32912025-07-01T00:18:17.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a6753fda-f362-47a8-be23-7f05d8406fee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32922025-07-01T00:18:17.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a6753fda-f362-47a8-be23-7f05d8406fee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32932025-07-01T00:18:18.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f508f003-3f64-4890-bb07-fec377059936 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32942025-07-01T00:18:18.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f508f003-3f64-4890-bb07-fec377059936 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32952025-07-01T00:18:18.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f508f003-3f64-4890-bb07-fec377059936 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
32962025-07-01T00:18:19.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 102849cb-0743-46eb-83d9-891c0bc6dba6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
32972025-07-01T00:18:19.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 102849cb-0743-46eb-83d9-891c0bc6dba6 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
32982025-07-01T00:18:19.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 102849cb-0743-46eb-83d9-891c0bc6dba6 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
32992025-07-01T00:18:19.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 3610a0db-e936-4604-bc72-e2254241b34c roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
33002025-07-01T00:18:19.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 3610a0db-e936-4604-bc72-e2254241b34c resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
33012025-07-01T00:18:19.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 3610a0db-e936-4604-bc72-e2254241b34c response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
33022025-07-01T00:18:19.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7d2dfbb1-e6e2-4c63-b205-5dd836bd1ad9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33032025-07-01T00:18:19.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7d2dfbb1-e6e2-4c63-b205-5dd836bd1ad9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33042025-07-01T00:18:19.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7d2dfbb1-e6e2-4c63-b205-5dd836bd1ad9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33052025-07-01T00:18:20.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ecb3952-7cce-4ace-ba36-f42b2f5ae82b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33062025-07-01T00:18:20.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ecb3952-7cce-4ace-ba36-f42b2f5ae82b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33072025-07-01T00:18:20.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ecb3952-7cce-4ace-ba36-f42b2f5ae82b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33082025-07-01T00:18:21.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3edc2df0-4c4a-4d49-a4a6-2c3140c7dd34 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33092025-07-01T00:18:21.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3edc2df0-4c4a-4d49-a4a6-2c3140c7dd34 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33102025-07-01T00:18:21.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3edc2df0-4c4a-4d49-a4a6-2c3140c7dd34 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33112025-07-01T00:18:23.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3e94fe3c-9a27-4f0a-821d-3bc8080303a7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33122025-07-01T00:18:23.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3e94fe3c-9a27-4f0a-821d-3bc8080303a7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33132025-07-01T00:18:23.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3e94fe3c-9a27-4f0a-821d-3bc8080303a7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
33142025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
33152025-07-01T00:18:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
33162025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.631\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
33172025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
33182025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
33192025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33202025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33212025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
33222025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
33232025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
33242025-07-01T00:18:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:08:23.901075016 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33252025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33262025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
33272025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
33282025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33292025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
33302025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
33312025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33322025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33332025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33342025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33352025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
33362025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
33372025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33382025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33392025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33402025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33412025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33422025-07-01T00:18:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33432025-07-01T00:18:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1433, tv_nsec: 727054748 } })
33442025-07-01T00:18:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1433, tv_nsec: 727144610 } })
33452025-07-01T00:18:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33462025-07-01T00:18:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 978.707\u{b5}s iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33472025-07-01T00:18:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
33482025-07-01T00:18:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.139661ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
33492025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 11 reason = Timeout
33502025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
33512025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.801\u{b5}s iteration = 11 status = "Disabled"
33522025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
33532025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
33542025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33552025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
33562025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33572025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33582025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33592025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
33602025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
33612025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33622025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33632025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
33642025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
33652025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33662025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
33672025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33682025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33692025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
33702025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
33712025-07-01T00:18:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
33722025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33732025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33742025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
33752025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33762025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
33772025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
33782025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33792025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33802025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
33812025-07-01T00:18:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33822025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33832025-07-01T00:18:23.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1433, tv_nsec: 729001191 } })
33842025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33852025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33862025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33872025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33882025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33892025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33902025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33912025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33922025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33932025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33942025-07-01T00:18:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33952025-07-01T00:18:23.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
33962025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33972025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33982025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33992025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34002025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34022025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.466005ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34032025-07-01T00:18:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34042025-07-01T00:18:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34052025-07-01T00:18:23.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:08:23.901075016 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34062025-07-01T00:18:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.652957ms iteration = 8 status = {"expiration":"2025-07-01T00:08:23.901075016Z","pruned":[]}
34072025-07-01T00:18:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1433, tv_nsec: 731693135 } })
34082025-07-01T00:18:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
34092025-07-01T00:18:23.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34102025-07-01T00:18:23.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34112025-07-01T00:18:23.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34122025-07-01T00:18:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34132025-07-01T00:18:23.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34142025-07-01T00:18:23.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34152025-07-01T00:18:23.908ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162025-07-01T00:18:23.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34172025-07-01T00:18:23.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182025-07-01T00:18:23.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192025-07-01T00:18:23.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202025-07-01T00:18:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34212025-07-01T00:18:23.911ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34222025-07-01T00:18:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34232025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34252025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34262025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34272025-07-01T00:18:23.912ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34282025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.946305ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34292025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302025-07-01T00:18:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34312025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
34332025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
34342025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34352025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
34362025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34372025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
34382025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
34392025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34402025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 8 reason = Timeout
34412025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
34422025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 15 reason = Timeout
34432025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
34442025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34452025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
34462025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34472025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 8 reason = Timeout
34482025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
34492025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
34502025-07-01T00:18:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34512025-07-01T00:18:23.914ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1433, tv_nsec: 739315853 } })
34522025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34532025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34542025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
34552025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34562025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34572025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34582025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34592025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
34602025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34612025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34622025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34632025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34642025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34652025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34662025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34672025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34682025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34692025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34702025-07-01T00:18:23.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34712025-07-01T00:18:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34722025-07-01T00:18:23.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34732025-07-01T00:18:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34742025-07-01T00:18:23.916ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.137325ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
34752025-07-01T00:18:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34762025-07-01T00:18:23.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34772025-07-01T00:18:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34782025-07-01T00:18:23.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.511116ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
34792025-07-01T00:18:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34802025-07-01T00:18:23.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.374609ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
34812025-07-01T00:18:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34822025-07-01T00:18:23.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34832025-07-01T00:18:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34842025-07-01T00:18:23.919ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
34852025-07-01T00:18:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.508191ms iteration = 8 status = {"by_rx":{},"error":null}
34862025-07-01T00:18:23.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34872025-07-01T00:18:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34882025-07-01T00:18:23.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34892025-07-01T00:18:23.920ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1433, tv_nsec: 746243463 } })
34902025-07-01T00:18:23.921ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
34912025-07-01T00:18:23.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34922025-07-01T00:18:23.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34932025-07-01T00:18:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34942025-07-01T00:18:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34952025-07-01T00:18:23.923ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
34962025-07-01T00:18:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
34972025-07-01T00:18:23.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34982025-07-01T00:18:23.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34992025-07-01T00:18:23.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35002025-07-01T00:18:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35012025-07-01T00:18:23.926ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 13.194672ms iteration = 8 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
35022025-07-01T00:18:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35032025-07-01T00:18:23.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35042025-07-01T00:18:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35052025-07-01T00:18:23.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.719928ms iteration = 17 status = {"physical_disks_added":0}
35062025-07-01T00:18:23.959ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35072025-07-01T00:18:23.959ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35082025-07-01T00:18:23.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35092025-07-01T00:18:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35102025-07-01T00:18:23.961ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35112025-07-01T00:18:23.961ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35122025-07-01T00:18:23.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35132025-07-01T00:18:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35142025-07-01T00:18:23.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35152025-07-01T00:18:23.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35162025-07-01T00:18:23.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35172025-07-01T00:18:23.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35182025-07-01T00:18:23.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192025-07-01T00:18:23.975ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35202025-07-01T00:18:23.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35212025-07-01T00:18:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35222025-07-01T00:18:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.703799ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35232025-07-01T00:18:23.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35242025-07-01T00:18:23.977ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 63.787415ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
35252025-07-01T00:18:23.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35262025-07-01T00:18:23.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35272025-07-01T00:18:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35282025-07-01T00:18:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35292025-07-01T00:18:23.978ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35302025-07-01T00:18:23.978ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
35312025-07-01T00:18:23.978ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.038473ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35322025-07-01T00:18:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
35332025-07-01T00:18:23.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35342025-07-01T00:18:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35352025-07-01T00:18:23.981ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35362025-07-01T00:18:23.982ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35372025-07-01T00:18:23.982ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35382025-07-01T00:18:23.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35392025-07-01T00:18:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35402025-07-01T00:18:23.983ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35412025-07-01T00:18:23.983ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.789903ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35422025-07-01T00:18:23.983ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35432025-07-01T00:18:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35442025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35452025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35462025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35472025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35482025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35492025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35502025-07-01T00:18:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35512025-07-01T00:18:23.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35522025-07-01T00:18:23.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.25182ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35532025-07-01T00:18:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35542025-07-01T00:18:23.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35552025-07-01T00:18:23.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.82976ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35562025-07-01T00:18:23.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35572025-07-01T00:18:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35582025-07-01T00:18:23.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592025-07-01T00:18:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35602025-07-01T00:18:23.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35612025-07-01T00:18:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35622025-07-01T00:18:23.992ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35632025-07-01T00:18:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
35642025-07-01T00:18:23.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35652025-07-01T00:18:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35662025-07-01T00:18:23.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35672025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35682025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.846706ms iteration = 15 status = 0
35692025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
35702025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.276907ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
35712025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35722025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35732025-07-01T00:18:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35742025-07-01T00:18:23.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752025-07-01T00:18:23.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35762025-07-01T00:18:23.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35772025-07-01T00:18:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35782025-07-01T00:18:24.012ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35792025-07-01T00:18:24.012ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35802025-07-01T00:18:24.012ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.495215ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35812025-07-01T00:18:24.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.98415ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35822025-07-01T00:18:24.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35832025-07-01T00:18:24.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 50d8e50a-c52b-4581-bad7-0d310fa9bec9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
35842025-07-01T00:18:24.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 50d8e50a-c52b-4581-bad7-0d310fa9bec9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
35852025-07-01T00:18:24.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35862025-07-01T00:18:24.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35872025-07-01T00:18:24.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35882025-07-01T00:18:24.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 50d8e50a-c52b-4581-bad7-0d310fa9bec9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
35892025-07-01T00:18:24.030ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35902025-07-01T00:18:24.030ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35912025-07-01T00:18:24.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35922025-07-01T00:18:24.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35932025-07-01T00:18:24.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35942025-07-01T00:18:24.034ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35952025-07-01T00:18:24.034ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
35962025-07-01T00:18:24.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35972025-07-01T00:18:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35982025-07-01T00:18:24.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992025-07-01T00:18:24.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36002025-07-01T00:18:24.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36012025-07-01T00:18:24.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36022025-07-01T00:18:24.036ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
36032025-07-01T00:18:24.036ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 133.188555ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36042025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36052025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36062025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36072025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
36082025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36092025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
36102025-07-01T00:18:24.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.833921ms iteration = 8 status = {"generation":1}
36112025-07-01T00:18:24.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36122025-07-01T00:18:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36132025-07-01T00:18:24.043ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
36142025-07-01T00:18:24.043ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 141.897282ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36152025-07-01T00:18:24.044ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
36162025-07-01T00:18:24.044ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36172025-07-01T00:18:24.044ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
36182025-07-01T00:18:24.044ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 143.444414ms iteration = 8 status = {"generation":2}
36192025-07-01T00:18:24.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36202025-07-01T00:18:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36212025-07-01T00:18:24.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222025-07-01T00:18:24.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36232025-07-01T00:18:24.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36242025-07-01T00:18:24.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36252025-07-01T00:18:24.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36262025-07-01T00:18:24.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36272025-07-01T00:18:24.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36282025-07-01T00:18:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36292025-07-01T00:18:24.089ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36302025-07-01T00:18:24.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
36312025-07-01T00:18:24.185ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36322025-07-01T00:18:24.185ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06cd98f7-405c-439a-8570-5301d190f124", "content-length": "26", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36332025-07-01T00:18:24.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36342025-07-01T00:18:24.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36352025-07-01T00:18:24.206ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
36362025-07-01T00:18:24.206ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 302.717942ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36372025-07-01T00:18:24.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36382025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
36392025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc069364-95d9-479f-bbe3-f24eb358a83e", "content-length": "78", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36402025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
36412025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
36422025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
36432025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
36442025-07-01T00:18:24.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
36452025-07-01T00:18:24.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
36462025-07-01T00:18:24.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
36472025-07-01T00:18:24.265ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36482025-07-01T00:18:24.266ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f4509ed-2a47-44a1-929f-f0c757957a30", "content-length": "26", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36492025-07-01T00:18:24.266ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36502025-07-01T00:18:24.266ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
36512025-07-01T00:18:24.267ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
36522025-07-01T00:18:24.267ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
36532025-07-01T00:18:24.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36542025-07-01T00:18:24.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
36552025-07-01T00:18:24.269ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
36562025-07-01T00:18:24.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
36572025-07-01T00:18:24.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
36582025-07-01T00:18:24.270ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
36592025-07-01T00:18:24.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
36602025-07-01T00:18:24.270ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
36612025-07-01T00:18:24.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
36622025-07-01T00:18:24.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
36632025-07-01T00:18:24.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
36642025-07-01T00:18:24.280ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36652025-07-01T00:18:24.281ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48a22ca8-a4b2-4d46-abe7-7ceb3cbc8c8f", "content-length": "26", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36662025-07-01T00:18:24.281ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36672025-07-01T00:18:24.283ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
36682025-07-01T00:18:24.312ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
36692025-07-01T00:18:24.312ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
36702025-07-01T00:18:24.312ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e300dd50-3f88-41a3-ac02-21182a195c26", "content-length": "81", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36712025-07-01T00:18:24.312ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
36722025-07-01T00:18:24.312ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
36732025-07-01T00:18:24.313ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "428ebc2f-632f-48d2-b211-572c9d214af2", "content-length": "81", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36742025-07-01T00:18:24.321ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
36752025-07-01T00:18:24.321ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
36762025-07-01T00:18:24.321ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3dbfa10-c553-4599-8f2a-48c530b35b96", "content-length": "81", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36772025-07-01T00:18:24.323ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 410.09617ms iteration = 15 status = {"errors":[],"sps":[]}
36782025-07-01T00:18:24.403ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36792025-07-01T00:18:24.403ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36802025-07-01T00:18:24.403ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "939fdeac-7f78-4b75-af5c-933a535b6dd9", "content-length": "372", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36812025-07-01T00:18:24.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36822025-07-01T00:18:24.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36832025-07-01T00:18:24.429ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36842025-07-01T00:18:24.454ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36852025-07-01T00:18:24.454ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36862025-07-01T00:18:24.454ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "561683c3-a438-4dff-8380-3c1dcf3e6582", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
36872025-07-01T00:18:24.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36882025-07-01T00:18:24.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36892025-07-01T00:18:24.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36902025-07-01T00:18:24.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36912025-07-01T00:18:24.460ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36922025-07-01T00:18:24.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36932025-07-01T00:18:24.460ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d2004a6b-ea1b-4a2e-a4c8-6736c6109a0c", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36942025-07-01T00:18:24.460ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36952025-07-01T00:18:24.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36962025-07-01T00:18:24.463ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "97bcf5f1-7690-4112-bdb1-880b55feab1e", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36972025-07-01T00:18:24.463ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36982025-07-01T00:18:24.464ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36992025-07-01T00:18:24.464ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37002025-07-01T00:18:24.464ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "78900778-d1d3-490f-b344-ba1c5838fc35", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
37012025-07-01T00:18:24.465ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37022025-07-01T00:18:24.465ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 564.33181ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37032025-07-01T00:18:24.470ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 566.722485ms iteration = 15 status = {}
37042025-07-01T00:18:24.470ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37052025-07-01T00:18:24.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37062025-07-01T00:18:24.473ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 572.377329ms iteration = 15 status = null
37072025-07-01T00:18:24.491ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 590.131865ms iteration = 15 status = {}
37082025-07-01T00:18:24.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37092025-07-01T00:18:24.497ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a74f715-6c8a-40f6-b019-caf224da8799", "content-length": "691", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
37102025-07-01T00:18:24.497ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37112025-07-01T00:18:24.497ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37122025-07-01T00:18:24.497ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37132025-07-01T00:18:24.499ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 596.037526ms iteration = 15 status = {}
37142025-07-01T00:18:24.526ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37152025-07-01T00:18:24.527ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "57937717-ce85-46a9-871e-296f1df45114", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37162025-07-01T00:18:24.527ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37172025-07-01T00:18:24.529ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "14db488e-5116-4b55-b169-d8a60f4bd800", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37182025-07-01T00:18:24.529ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37192025-07-01T00:18:24.531ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6e853cd2-eb81-4c47-ba48-1fe01ffb6a76", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37202025-07-01T00:18:24.531ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37212025-07-01T00:18:24.533ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37222025-07-01T00:18:24.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 632.014511ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37232025-07-01T00:18:24.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37242025-07-01T00:18:24.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37252025-07-01T00:18:24.572ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
37262025-07-01T00:18:24.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37272025-07-01T00:18:24.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37282025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
37292025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
37302025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37312025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37322025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37332025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37342025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37352025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37362025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37372025-07-01T00:18:24.585ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37382025-07-01T00:18:24.586ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
37392025-07-01T00:18:24.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37402025-07-01T00:18:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37412025-07-01T00:18:24.588ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
37422025-07-01T00:18:24.589ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37432025-07-01T00:18:24.692ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a82bbb9-2288-4db8-8814-f5ba3ff73a85", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
37442025-07-01T00:18:24.692ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
37452025-07-01T00:18:24.692ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37462025-07-01T00:18:24.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0fd8155-c67c-46ec-b854-bdf5b250d5be", "content-length": "682", "date": "Tue, 01 Jul 2025 00:18:24 GMT"} })
37472025-07-01T00:18:24.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37482025-07-01T00:18:24.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37492025-07-01T00:18:24.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37502025-07-01T00:18:24.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37512025-07-01T00:18:24.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37522025-07-01T00:18:24.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37532025-07-01T00:18:24.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37542025-07-01T00:18:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37552025-07-01T00:18:24.710ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 807.272296ms iteration = 15 status = {}
37562025-07-01T00:18:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = ea55a6f1-846f-4ce2-8f1d-c8d69956d680 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
37572025-07-01T00:18:25.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c67b0edb-c7bb-46ae-9295-246ebe4f7977 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37582025-07-01T00:18:25.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c67b0edb-c7bb-46ae-9295-246ebe4f7977 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37592025-07-01T00:18:25.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c67b0edb-c7bb-46ae-9295-246ebe4f7977 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37602025-07-01T00:18:26.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6be8e3a9-1dad-4c19-92ff-8b4e5c5f0412 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37612025-07-01T00:18:26.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6be8e3a9-1dad-4c19-92ff-8b4e5c5f0412 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37622025-07-01T00:18:26.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2556 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6be8e3a9-1dad-4c19-92ff-8b4e5c5f0412 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37632025-07-01T00:18:27.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f5ecc71-6ac3-454e-b035-1851459b0d02 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37642025-07-01T00:18:27.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f5ecc71-6ac3-454e-b035-1851459b0d02 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37652025-07-01T00:18:27.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f5ecc71-6ac3-454e-b035-1851459b0d02 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37662025-07-01T00:18:28.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a3aebd88-457c-44ec-b1af-54b48c654fa6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37672025-07-01T00:18:28.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a3aebd88-457c-44ec-b1af-54b48c654fa6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37682025-07-01T00:18:28.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a3aebd88-457c-44ec-b1af-54b48c654fa6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37692025-07-01T00:18:29.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2cfebc8e-7035-4da4-bad4-09b985631d41 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37702025-07-01T00:18:29.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2cfebc8e-7035-4da4-bad4-09b985631d41 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37712025-07-01T00:18:29.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2cfebc8e-7035-4da4-bad4-09b985631d41 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37722025-07-01T00:18:30.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f30d42ef-d19d-41c5-83dd-2c8e03f0a8b7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37732025-07-01T00:18:30.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f30d42ef-d19d-41c5-83dd-2c8e03f0a8b7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37742025-07-01T00:18:30.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f30d42ef-d19d-41c5-83dd-2c8e03f0a8b7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37752025-07-01T00:18:31.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ee7f1ecd-1922-42ac-b8cd-99acdcdc19b5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37762025-07-01T00:18:31.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ee7f1ecd-1922-42ac-b8cd-99acdcdc19b5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37772025-07-01T00:18:31.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ee7f1ecd-1922-42ac-b8cd-99acdcdc19b5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37782025-07-01T00:18:32.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0cc6a6d-d35d-4821-b484-f813f073e866 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37792025-07-01T00:18:32.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0cc6a6d-d35d-4821-b484-f813f073e866 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37802025-07-01T00:18:32.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0cc6a6d-d35d-4821-b484-f813f073e866 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37812025-07-01T00:18:33.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0e657611-48df-4f61-8469-cfaf5b550f9b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37822025-07-01T00:18:33.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0e657611-48df-4f61-8469-cfaf5b550f9b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37832025-07-01T00:18:33.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0e657611-48df-4f61-8469-cfaf5b550f9b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
37842025-07-01T00:18:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
37852025-07-01T00:18:33.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
37862025-07-01T00:18:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37872025-07-01T00:18:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37882025-07-01T00:18:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37892025-07-01T00:18:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37902025-07-01T00:18:33.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37912025-07-01T00:18:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37922025-07-01T00:18:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37932025-07-01T00:18:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37942025-07-01T00:18:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37952025-07-01T00:18:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37962025-07-01T00:18:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37972025-07-01T00:18:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37982025-07-01T00:18:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37992025-07-01T00:18:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
38002025-07-01T00:18:33.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38012025-07-01T00:18:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38022025-07-01T00:18:33.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
38032025-07-01T00:18:33.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.719909ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
38042025-07-01T00:18:33.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.831723ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38052025-07-01T00:18:34.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69a1f44c-6071-4e0c-8f4f-b151e3b85374 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38062025-07-01T00:18:34.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69a1f44c-6071-4e0c-8f4f-b151e3b85374 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38072025-07-01T00:18:34.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1658 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69a1f44c-6071-4e0c-8f4f-b151e3b85374 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38082025-07-01T00:18:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 44bfa949-a224-410b-9360-43d212ed9ae0 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
38092025-07-01T00:18:35.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 830decff-fbff-4baa-99aa-9729f2fcf100 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38102025-07-01T00:18:35.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 830decff-fbff-4baa-99aa-9729f2fcf100 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38112025-07-01T00:18:35.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 830decff-fbff-4baa-99aa-9729f2fcf100 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38122025-07-01T00:18:36.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 19c356d6-13f4-4e38-b3d1-e1e182b3147d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38132025-07-01T00:18:36.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 19c356d6-13f4-4e38-b3d1-e1e182b3147d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38142025-07-01T00:18:36.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 19c356d6-13f4-4e38-b3d1-e1e182b3147d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38152025-07-01T00:18:37.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 069c0518-1993-44ab-8689-85371d84e2db roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38162025-07-01T00:18:37.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 069c0518-1993-44ab-8689-85371d84e2db resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38172025-07-01T00:18:37.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 069c0518-1993-44ab-8689-85371d84e2db response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38182025-07-01T00:18:38.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0dc9b50a-d77e-49e6-bd53-25d2c4fec32f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38192025-07-01T00:18:38.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0dc9b50a-d77e-49e6-bd53-25d2c4fec32f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38202025-07-01T00:18:38.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0dc9b50a-d77e-49e6-bd53-25d2c4fec32f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38212025-07-01T00:18:39.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f36c9a8e-a566-46e6-9718-74351d6561fa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38222025-07-01T00:18:39.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f36c9a8e-a566-46e6-9718-74351d6561fa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38232025-07-01T00:18:39.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f36c9a8e-a566-46e6-9718-74351d6561fa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38242025-07-01T00:18:40.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6003c100-3439-4d66-8da5-bc222b2d7623 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38252025-07-01T00:18:40.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6003c100-3439-4d66-8da5-bc222b2d7623 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38262025-07-01T00:18:40.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6003c100-3439-4d66-8da5-bc222b2d7623 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38272025-07-01T00:18:41.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd07fc46-2a9d-440d-b5d3-6f329dcca414 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38282025-07-01T00:18:41.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd07fc46-2a9d-440d-b5d3-6f329dcca414 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38292025-07-01T00:18:41.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd07fc46-2a9d-440d-b5d3-6f329dcca414 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38302025-07-01T00:18:42.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = baea8e35-e995-4d40-b73f-abae0c872bf2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38312025-07-01T00:18:42.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = baea8e35-e995-4d40-b73f-abae0c872bf2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38322025-07-01T00:18:42.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = baea8e35-e995-4d40-b73f-abae0c872bf2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38332025-07-01T00:18:43.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f43da1e0-d1cd-4be6-a146-0aefd7cd5dcd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38342025-07-01T00:18:43.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f43da1e0-d1cd-4be6-a146-0aefd7cd5dcd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38352025-07-01T00:18:43.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f43da1e0-d1cd-4be6-a146-0aefd7cd5dcd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38362025-07-01T00:18:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
38372025-07-01T00:18:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
38382025-07-01T00:18:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38392025-07-01T00:18:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38402025-07-01T00:18:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38412025-07-01T00:18:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38422025-07-01T00:18:43.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38432025-07-01T00:18:43.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38442025-07-01T00:18:43.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38452025-07-01T00:18:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.087842ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38462025-07-01T00:18:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38472025-07-01T00:18:43.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38482025-07-01T00:18:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38492025-07-01T00:18:43.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38502025-07-01T00:18:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38512025-07-01T00:18:43.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38522025-07-01T00:18:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
38532025-07-01T00:18:43.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38542025-07-01T00:18:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38552025-07-01T00:18:43.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
38562025-07-01T00:18:43.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.172214ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
38572025-07-01T00:18:44.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f1bba99-f2b6-45e9-bc64-cf8ca87d59e6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38582025-07-01T00:18:44.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f1bba99-f2b6-45e9-bc64-cf8ca87d59e6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38592025-07-01T00:18:44.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3f1bba99-f2b6-45e9-bc64-cf8ca87d59e6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38602025-07-01T00:18:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 814 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 9003c79b-1de5-4774-ba4b-7b23b3e6c9d7 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
38612025-07-01T00:18:45.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 50cc3c65-c9af-4576-80f8-5cd302b6ed5b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38622025-07-01T00:18:45.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 50cc3c65-c9af-4576-80f8-5cd302b6ed5b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38632025-07-01T00:18:45.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 50cc3c65-c9af-4576-80f8-5cd302b6ed5b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38642025-07-01T00:18:46.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4adee953-68f9-41d7-b570-e36ad5686e38 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38652025-07-01T00:18:46.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4adee953-68f9-41d7-b570-e36ad5686e38 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38662025-07-01T00:18:46.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4adee953-68f9-41d7-b570-e36ad5686e38 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38672025-07-01T00:18:47.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3221a60-127d-4271-bdae-153fcbec0e63 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38682025-07-01T00:18:47.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3221a60-127d-4271-bdae-153fcbec0e63 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38692025-07-01T00:18:47.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f3221a60-127d-4271-bdae-153fcbec0e63 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38702025-07-01T00:18:48.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e3eac989-8778-4bdf-8326-8b07b70f834a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38712025-07-01T00:18:48.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e3eac989-8778-4bdf-8326-8b07b70f834a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38722025-07-01T00:18:48.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1651 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e3eac989-8778-4bdf-8326-8b07b70f834a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38732025-07-01T00:18:49.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c9792eda-46d3-4a6d-9d12-5f42134b8701 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38742025-07-01T00:18:49.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c9792eda-46d3-4a6d-9d12-5f42134b8701 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38752025-07-01T00:18:49.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2557 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c9792eda-46d3-4a6d-9d12-5f42134b8701 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38762025-07-01T00:18:49.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 9fc445bc-9ab4-4860-89c1-f7518eb3753b roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
38772025-07-01T00:18:49.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 9fc445bc-9ab4-4860-89c1-f7518eb3753b resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
38782025-07-01T00:18:49.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3086 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 9fc445bc-9ab4-4860-89c1-f7518eb3753b response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
38792025-07-01T00:18:49.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 79d8f0a3-3b06-4f23-b7cf-a66a4a8b80d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
38802025-07-01T00:18:49.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 79d8f0a3-3b06-4f23-b7cf-a66a4a8b80d2 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
38812025-07-01T00:18:49.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35238 req_id = 79d8f0a3-3b06-4f23-b7cf-a66a4a8b80d2 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
38822025-07-01T00:18:50.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6ffa346-cd3b-446b-8591-5e208567ec76 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38832025-07-01T00:18:50.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6ffa346-cd3b-446b-8591-5e208567ec76 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38842025-07-01T00:18:50.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6ffa346-cd3b-446b-8591-5e208567ec76 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38852025-07-01T00:18:51.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 514e5fa6-e05b-46b6-8a70-b7a667f546ca roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38862025-07-01T00:18:51.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 514e5fa6-e05b-46b6-8a70-b7a667f546ca resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38872025-07-01T00:18:51.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 514e5fa6-e05b-46b6-8a70-b7a667f546ca response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38882025-07-01T00:18:52.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01c7efb8-af5f-4c1a-8769-38d665150780 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38892025-07-01T00:18:52.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01c7efb8-af5f-4c1a-8769-38d665150780 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38902025-07-01T00:18:52.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 01c7efb8-af5f-4c1a-8769-38d665150780 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38912025-07-01T00:18:53.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 551b7efe-a85b-4fec-91a6-9b60715c91b4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38922025-07-01T00:18:53.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 551b7efe-a85b-4fec-91a6-9b60715c91b4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38932025-07-01T00:18:53.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 551b7efe-a85b-4fec-91a6-9b60715c91b4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
38942025-07-01T00:18:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
38952025-07-01T00:18:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
38962025-07-01T00:18:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
38972025-07-01T00:18:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38982025-07-01T00:18:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38992025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39002025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39012025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
39022025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
39032025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39042025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39052025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
39062025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39072025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
39082025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39092025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
39102025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39112025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
39122025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
39132025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39142025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39152025-07-01T00:18:53.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39162025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
39172025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
39182025-07-01T00:18:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39192025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39202025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39212025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
39222025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39232025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
39242025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39252025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39262025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39272025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39282025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39292025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39302025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39312025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39322025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39332025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39342025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352025-07-01T00:18:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39362025-07-01T00:18:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1463, tv_nsec: 730116942 } })
39372025-07-01T00:18:53.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382025-07-01T00:18:53.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392025-07-01T00:18:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
39402025-07-01T00:18:53.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1463, tv_nsec: 730521873 } })
39412025-07-01T00:18:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
39422025-07-01T00:18:53.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39432025-07-01T00:18:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.958979ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39442025-07-01T00:18:53.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39452025-07-01T00:18:53.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39462025-07-01T00:18:53.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39472025-07-01T00:18:53.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39482025-07-01T00:18:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39492025-07-01T00:18:53.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39502025-07-01T00:18:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39512025-07-01T00:18:53.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39522025-07-01T00:18:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39532025-07-01T00:18:53.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39542025-07-01T00:18:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39552025-07-01T00:18:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39562025-07-01T00:18:53.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.188859ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39572025-07-01T00:18:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39582025-07-01T00:18:53.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39592025-07-01T00:18:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39602025-07-01T00:18:53.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39612025-07-01T00:18:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39622025-07-01T00:18:53.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39632025-07-01T00:18:53.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39642025-07-01T00:18:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39652025-07-01T00:18:53.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39662025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39672025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39682025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39692025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39702025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39712025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39722025-07-01T00:18:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39732025-07-01T00:18:53.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1463, tv_nsec: 737881934 } })
39742025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39752025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39762025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39772025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
39782025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39792025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
39802025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39812025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
39822025-07-01T00:18:53.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
39832025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39842025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 16 reason = Timeout
39852025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
39862025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39872025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
39882025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
39892025-07-01T00:18:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39902025-07-01T00:18:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39912025-07-01T00:18:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
39922025-07-01T00:18:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39932025-07-01T00:18:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39942025-07-01T00:18:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1463, tv_nsec: 738619614 } })
39952025-07-01T00:18:53.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39962025-07-01T00:18:53.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39972025-07-01T00:18:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39982025-07-01T00:18:53.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.155309ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
39992025-07-01T00:18:53.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40002025-07-01T00:18:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40012025-07-01T00:18:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40022025-07-01T00:18:53.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40032025-07-01T00:18:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40042025-07-01T00:18:53.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40052025-07-01T00:18:53.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40062025-07-01T00:18:53.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 15.383321ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40072025-07-01T00:18:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
40082025-07-01T00:18:53.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40092025-07-01T00:18:53.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40102025-07-01T00:18:53.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
40112025-07-01T00:18:53.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.845117ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
40122025-07-01T00:18:53.948ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40132025-07-01T00:18:53.948ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40142025-07-01T00:18:53.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40152025-07-01T00:18:53.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40162025-07-01T00:18:53.956ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40172025-07-01T00:18:53.956ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40182025-07-01T00:18:53.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40192025-07-01T00:18:53.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40202025-07-01T00:18:53.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212025-07-01T00:18:53.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.243549ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40222025-07-01T00:18:53.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40232025-07-01T00:18:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40242025-07-01T00:18:53.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40252025-07-01T00:18:53.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40262025-07-01T00:18:53.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40272025-07-01T00:18:53.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40282025-07-01T00:18:53.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.700583ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
40292025-07-01T00:18:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40302025-07-01T00:18:53.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.291146ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40312025-07-01T00:18:53.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40322025-07-01T00:18:53.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40332025-07-01T00:18:53.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40342025-07-01T00:18:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40352025-07-01T00:18:53.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40362025-07-01T00:18:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40372025-07-01T00:18:53.968ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40382025-07-01T00:18:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40392025-07-01T00:18:53.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402025-07-01T00:18:53.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40412025-07-01T00:18:53.977ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40422025-07-01T00:18:53.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40432025-07-01T00:18:53.978ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40442025-07-01T00:18:53.978ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.976656ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
40452025-07-01T00:18:53.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40462025-07-01T00:18:53.998ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40472025-07-01T00:18:53.998ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40482025-07-01T00:18:53.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.808601ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40492025-07-01T00:18:54.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
40502025-07-01T00:18:54.002ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40512025-07-01T00:18:54.002ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72956fec-76e4-41d0-935a-52a8eb58a8b0", "content-length": "26", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
40522025-07-01T00:18:54.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40532025-07-01T00:18:54.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40542025-07-01T00:18:54.014ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
40552025-07-01T00:18:54.014ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 112.028355ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40562025-07-01T00:18:54.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
40572025-07-01T00:18:54.016ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40582025-07-01T00:18:54.017ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d61781f-6cb0-45d5-9931-b55f66f547ab", "content-length": "26", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
40592025-07-01T00:18:54.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40602025-07-01T00:18:54.017ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
40612025-07-01T00:18:54.017ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6a59802-a66b-4b9e-95a2-9c66946758c3", "content-length": "78", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
40622025-07-01T00:18:54.017ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
40632025-07-01T00:18:54.017ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
40642025-07-01T00:18:54.017ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
40652025-07-01T00:18:54.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
40662025-07-01T00:18:54.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
40672025-07-01T00:18:54.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
40682025-07-01T00:18:54.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.395761ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40692025-07-01T00:18:54.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40702025-07-01T00:18:54.019ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
40712025-07-01T00:18:54.020ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
40722025-07-01T00:18:54.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732025-07-01T00:18:54.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
40742025-07-01T00:18:54.022ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
40752025-07-01T00:18:54.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
40762025-07-01T00:18:54.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
40772025-07-01T00:18:54.023ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
40782025-07-01T00:18:54.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
40792025-07-01T00:18:54.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
40802025-07-01T00:18:54.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40812025-07-01T00:18:54.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40822025-07-01T00:18:54.027ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.437344ms iteration = 16 status = 0
40832025-07-01T00:18:54.037ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.766137ms iteration = 18 status = {"physical_disks_added":0}
40842025-07-01T00:18:54.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
40852025-07-01T00:18:54.044ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40862025-07-01T00:18:54.045ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7422788e-87d4-460f-b28e-36f29f7fa155", "content-length": "26", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
40872025-07-01T00:18:54.045ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40882025-07-01T00:18:54.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
40892025-07-01T00:18:54.054ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
40902025-07-01T00:18:54.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
40912025-07-01T00:18:54.056ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
40922025-07-01T00:18:54.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
40932025-07-01T00:18:54.059ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
40942025-07-01T00:18:54.059ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
40952025-07-01T00:18:54.060ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
40962025-07-01T00:18:54.060ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
40972025-07-01T00:18:54.060ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8d96652-e944-4289-bca1-2695cb4242c9", "content-length": "81", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
40982025-07-01T00:18:54.060ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f750d86-bca8-4d37-bd11-0bcda8b66918", "content-length": "81", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
40992025-07-01T00:18:54.076ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41002025-07-01T00:18:54.076ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41012025-07-01T00:18:54.076ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8117556a-10ca-4d05-b890-59c75fcccaf3", "content-length": "372", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41022025-07-01T00:18:54.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41032025-07-01T00:18:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41042025-07-01T00:18:54.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41052025-07-01T00:18:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41062025-07-01T00:18:54.094ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
41072025-07-01T00:18:54.094ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
41082025-07-01T00:18:54.094ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc284389-c8c3-4525-83ea-8088e55287df", "content-length": "81", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41092025-07-01T00:18:54.096ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 183.379577ms iteration = 16 status = {"errors":[],"sps":[]}
41102025-07-01T00:18:54.119ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.449679ms iteration = 16 status = {}
41112025-07-01T00:18:54.132ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41122025-07-01T00:18:54.132ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41132025-07-01T00:18:54.132ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b18ecede-3a5e-40f4-93d5-710043988fac", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41142025-07-01T00:18:54.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41152025-07-01T00:18:54.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41162025-07-01T00:18:54.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41172025-07-01T00:18:54.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41182025-07-01T00:18:54.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41192025-07-01T00:18:54.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41202025-07-01T00:18:54.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41212025-07-01T00:18:54.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41222025-07-01T00:18:54.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41232025-07-01T00:18:54.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41242025-07-01T00:18:54.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41252025-07-01T00:18:54.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41262025-07-01T00:18:54.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41272025-07-01T00:18:54.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41282025-07-01T00:18:54.141ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41292025-07-01T00:18:54.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41302025-07-01T00:18:54.142ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "629c372f-759c-45a0-a04d-cebc9c6d8a61", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41312025-07-01T00:18:54.144ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.142678ms iteration = 16 status = {}
41322025-07-01T00:18:54.222ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41332025-07-01T00:18:54.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41342025-07-01T00:18:54.224ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 322.935505ms iteration = 16 status = null
41352025-07-01T00:18:54.232ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41362025-07-01T00:18:54.232ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a5bf72d-8bab-4017-b3c1-8482a6d8bbed", "content-length": "691", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41372025-07-01T00:18:54.232ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41382025-07-01T00:18:54.232ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41392025-07-01T00:18:54.232ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41402025-07-01T00:18:54.234ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.790868ms iteration = 16 status = {}
41412025-07-01T00:18:54.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41422025-07-01T00:18:54.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41432025-07-01T00:18:54.294ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
41442025-07-01T00:18:54.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41452025-07-01T00:18:54.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41462025-07-01T00:18:54.306ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
41472025-07-01T00:18:54.306ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
41482025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41492025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41502025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41512025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41522025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41532025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41542025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41552025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41562025-07-01T00:18:54.307ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
41572025-07-01T00:18:54.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41582025-07-01T00:18:54.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41592025-07-01T00:18:54.309ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
41602025-07-01T00:18:54.309ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41612025-07-01T00:18:54.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "40a8afe6-ae52-4717-8c1c-44d6b985d9c8", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41622025-07-01T00:18:54.410ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
41632025-07-01T00:18:54.410ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41642025-07-01T00:18:54.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2570625d-cd47-4001-a6fa-b9d2e1cd4044", "content-length": "682", "date": "Tue, 01 Jul 2025 00:18:54 GMT"} })
41652025-07-01T00:18:54.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41662025-07-01T00:18:54.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41672025-07-01T00:18:54.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41682025-07-01T00:18:54.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41692025-07-01T00:18:54.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41702025-07-01T00:18:54.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41712025-07-01T00:18:54.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41722025-07-01T00:18:54.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41732025-07-01T00:18:54.426ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 524.027417ms iteration = 16 status = {}
41742025-07-01T00:18:54.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88dd0a62-7ecf-486b-a960-8f20e65c3068 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41752025-07-01T00:18:54.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88dd0a62-7ecf-486b-a960-8f20e65c3068 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41762025-07-01T00:18:54.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88dd0a62-7ecf-486b-a960-8f20e65c3068 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41772025-07-01T00:18:54.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 475 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 23756636-18e2-4382-a705-435d42dfd688 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
41782025-07-01T00:18:55.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fd7d04c5-16d1-4310-9cd5-1220b52eaff0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41792025-07-01T00:18:55.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fd7d04c5-16d1-4310-9cd5-1220b52eaff0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41802025-07-01T00:18:55.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fd7d04c5-16d1-4310-9cd5-1220b52eaff0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41812025-07-01T00:18:56.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4f40ec1d-8bb5-469b-ba34-45cec17147fa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41822025-07-01T00:18:56.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4f40ec1d-8bb5-469b-ba34-45cec17147fa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41832025-07-01T00:18:56.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4f40ec1d-8bb5-469b-ba34-45cec17147fa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41842025-07-01T00:18:57.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6bf2648-b367-4ab2-a1e0-2552c1f02d98 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41852025-07-01T00:18:57.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6bf2648-b367-4ab2-a1e0-2552c1f02d98 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41862025-07-01T00:18:57.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6bf2648-b367-4ab2-a1e0-2552c1f02d98 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41872025-07-01T00:18:58.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 919b1612-dddf-4738-bc0f-9717924cee26 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41882025-07-01T00:18:58.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 919b1612-dddf-4738-bc0f-9717924cee26 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41892025-07-01T00:18:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 919b1612-dddf-4738-bc0f-9717924cee26 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41902025-07-01T00:18:59.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 853dec3a-ade1-48fd-a097-c47d815f87fa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41912025-07-01T00:18:59.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 853dec3a-ade1-48fd-a097-c47d815f87fa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41922025-07-01T00:18:59.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 853dec3a-ade1-48fd-a097-c47d815f87fa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41932025-07-01T00:19:00.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 56ac12b5-9f11-490a-9f49-7d30742b7d88 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41942025-07-01T00:19:00.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 56ac12b5-9f11-490a-9f49-7d30742b7d88 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41952025-07-01T00:19:00.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2924 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 56ac12b5-9f11-490a-9f49-7d30742b7d88 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41962025-07-01T00:19:01.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cba477b0-64fc-4466-aaba-7be81210fb60 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41972025-07-01T00:19:01.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cba477b0-64fc-4466-aaba-7be81210fb60 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41982025-07-01T00:19:01.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cba477b0-64fc-4466-aaba-7be81210fb60 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
41992025-07-01T00:19:02.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 94dd359a-4dcd-4e7c-920c-df68033545d0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42002025-07-01T00:19:02.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 94dd359a-4dcd-4e7c-920c-df68033545d0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42012025-07-01T00:19:02.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 94dd359a-4dcd-4e7c-920c-df68033545d0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42022025-07-01T00:19:03.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c0dd0e6-9a3c-49f5-b9b1-19ab73bd61fd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42032025-07-01T00:19:03.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c0dd0e6-9a3c-49f5-b9b1-19ab73bd61fd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42042025-07-01T00:19:03.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c0dd0e6-9a3c-49f5-b9b1-19ab73bd61fd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42052025-07-01T00:19:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
42062025-07-01T00:19:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42072025-07-01T00:19:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
42082025-07-01T00:19:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42092025-07-01T00:19:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42102025-07-01T00:19:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42112025-07-01T00:19:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122025-07-01T00:19:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42132025-07-01T00:19:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42142025-07-01T00:19:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42152025-07-01T00:19:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42162025-07-01T00:19:03.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42172025-07-01T00:19:03.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182025-07-01T00:19:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
42192025-07-01T00:19:03.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42202025-07-01T00:19:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42212025-07-01T00:19:03.927ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
42222025-07-01T00:19:03.927ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.458259ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
42232025-07-01T00:19:03.936ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42242025-07-01T00:19:03.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42252025-07-01T00:19:03.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.236434ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42262025-07-01T00:19:04.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ca5322f9-4c4c-4fb2-8d9c-12e1492f1a3f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42272025-07-01T00:19:04.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ca5322f9-4c4c-4fb2-8d9c-12e1492f1a3f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42282025-07-01T00:19:04.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1778 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ca5322f9-4c4c-4fb2-8d9c-12e1492f1a3f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42292025-07-01T00:19:04.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = b8aff8b3-6fab-4449-857d-fd671869874f response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
42302025-07-01T00:19:05.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c9e5a11-4873-40d8-834c-8f80608f5095 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42312025-07-01T00:19:05.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c9e5a11-4873-40d8-834c-8f80608f5095 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42322025-07-01T00:19:05.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c9e5a11-4873-40d8-834c-8f80608f5095 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42332025-07-01T00:19:06.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6552dfa8-1a1c-451d-9ca3-a18259104678 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42342025-07-01T00:19:06.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6552dfa8-1a1c-451d-9ca3-a18259104678 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42352025-07-01T00:19:06.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6552dfa8-1a1c-451d-9ca3-a18259104678 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42362025-07-01T00:19:07.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 29fe0ced-e22c-4113-830a-5a2762687c33 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42372025-07-01T00:19:07.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 29fe0ced-e22c-4113-830a-5a2762687c33 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42382025-07-01T00:19:07.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1770 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 29fe0ced-e22c-4113-830a-5a2762687c33 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42392025-07-01T00:19:08.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69f9bec7-ac6f-4fe7-be0f-80851c0edd6d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42402025-07-01T00:19:08.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69f9bec7-ac6f-4fe7-be0f-80851c0edd6d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42412025-07-01T00:19:08.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69f9bec7-ac6f-4fe7-be0f-80851c0edd6d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42422025-07-01T00:19:09.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab778afc-d79e-4931-bbc6-71eeb4da3001 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42432025-07-01T00:19:09.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab778afc-d79e-4931-bbc6-71eeb4da3001 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42442025-07-01T00:19:09.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab778afc-d79e-4931-bbc6-71eeb4da3001 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42452025-07-01T00:19:10.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25ff8d34-f0fb-4d7c-bdf4-fcbc68d44bb0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42462025-07-01T00:19:10.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25ff8d34-f0fb-4d7c-bdf4-fcbc68d44bb0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42472025-07-01T00:19:10.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25ff8d34-f0fb-4d7c-bdf4-fcbc68d44bb0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42482025-07-01T00:19:11.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 879b4c44-635f-4880-8fba-ea363090dee2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42492025-07-01T00:19:11.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 879b4c44-635f-4880-8fba-ea363090dee2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42502025-07-01T00:19:11.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 879b4c44-635f-4880-8fba-ea363090dee2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42512025-07-01T00:19:12.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 74cc8913-d563-41a6-8f34-c60722bd60ad roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42522025-07-01T00:19:12.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 74cc8913-d563-41a6-8f34-c60722bd60ad resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42532025-07-01T00:19:12.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 74cc8913-d563-41a6-8f34-c60722bd60ad response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42542025-07-01T00:19:13.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e3a7beb2-d05e-4e2c-84a9-079d4931fc46 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42552025-07-01T00:19:13.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e3a7beb2-d05e-4e2c-84a9-079d4931fc46 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42562025-07-01T00:19:13.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e3a7beb2-d05e-4e2c-84a9-079d4931fc46 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42572025-07-01T00:19:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
42582025-07-01T00:19:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42592025-07-01T00:19:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
42602025-07-01T00:19:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42612025-07-01T00:19:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42622025-07-01T00:19:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42632025-07-01T00:19:13.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42642025-07-01T00:19:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42652025-07-01T00:19:13.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42662025-07-01T00:19:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42672025-07-01T00:19:13.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42682025-07-01T00:19:13.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42692025-07-01T00:19:13.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42702025-07-01T00:19:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
42712025-07-01T00:19:13.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42722025-07-01T00:19:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42732025-07-01T00:19:13.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
42742025-07-01T00:19:13.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.792988ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
42752025-07-01T00:19:13.937ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42762025-07-01T00:19:13.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42772025-07-01T00:19:13.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.915671ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42782025-07-01T00:19:14.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5344cac-19e8-4de9-a26d-740ed2905035 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42792025-07-01T00:19:14.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5344cac-19e8-4de9-a26d-740ed2905035 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42802025-07-01T00:19:14.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5344cac-19e8-4de9-a26d-740ed2905035 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42812025-07-01T00:19:14.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = e2462d56-8090-42ec-9469-ad024fa075c0 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
42822025-07-01T00:19:15.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88ed0dea-494c-4e1c-8c36-6f39136bccaa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42832025-07-01T00:19:15.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88ed0dea-494c-4e1c-8c36-6f39136bccaa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42842025-07-01T00:19:15.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88ed0dea-494c-4e1c-8c36-6f39136bccaa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42852025-07-01T00:19:16.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 57340112-d268-4450-b687-fb36b4af18b2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42862025-07-01T00:19:16.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 57340112-d268-4450-b687-fb36b4af18b2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42872025-07-01T00:19:16.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2577 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 57340112-d268-4450-b687-fb36b4af18b2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42882025-07-01T00:19:17.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 98709a42-827d-4b73-994b-1488b29c4970 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42892025-07-01T00:19:17.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 98709a42-827d-4b73-994b-1488b29c4970 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42902025-07-01T00:19:17.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 98709a42-827d-4b73-994b-1488b29c4970 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42912025-07-01T00:19:18.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 03174b22-4029-43f4-a258-174f0f571523 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42922025-07-01T00:19:18.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 03174b22-4029-43f4-a258-174f0f571523 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42932025-07-01T00:19:18.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 03174b22-4029-43f4-a258-174f0f571523 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42942025-07-01T00:19:19.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 161ddc2c-a497-4d77-aff2-1f925bddd0a7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42952025-07-01T00:19:19.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 161ddc2c-a497-4d77-aff2-1f925bddd0a7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42962025-07-01T00:19:19.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 161ddc2c-a497-4d77-aff2-1f925bddd0a7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42972025-07-01T00:19:20.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55d20727-d875-48d5-a703-6f4a77c3dcd6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42982025-07-01T00:19:20.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55d20727-d875-48d5-a703-6f4a77c3dcd6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
42992025-07-01T00:19:20.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1743 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55d20727-d875-48d5-a703-6f4a77c3dcd6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43002025-07-01T00:19:21.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a9a0d22-acff-4344-b05b-bb8af3ba837e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43012025-07-01T00:19:21.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a9a0d22-acff-4344-b05b-bb8af3ba837e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43022025-07-01T00:19:21.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a9a0d22-acff-4344-b05b-bb8af3ba837e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43032025-07-01T00:19:22.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ecd0749f-7f82-4c35-ab57-47b0489d2ade roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43042025-07-01T00:19:22.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ecd0749f-7f82-4c35-ab57-47b0489d2ade resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43052025-07-01T00:19:22.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ecd0749f-7f82-4c35-ab57-47b0489d2ade response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
43062025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
43072025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
43082025-07-01T00:19:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
43092025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43102025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.941\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
43112025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43122025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
43132025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
43142025-07-01T00:19:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:09:23.901065346 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43152025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43162025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
43172025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
43182025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43192025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43202025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43212025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
43222025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
43232025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43242025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43252025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
43262025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
43272025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
43282025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
43292025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43302025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43312025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43322025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43332025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43342025-07-01T00:19:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43352025-07-01T00:19:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 727220592 } })
43362025-07-01T00:19:23.901ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 727218732 } })
43372025-07-01T00:19:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43382025-07-01T00:19:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.247094ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43392025-07-01T00:19:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43402025-07-01T00:19:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.239224ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43412025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43422025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 12 reason = Timeout
43432025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
43442025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.68\u{b5}s iteration = 12 status = "Disabled"
43452025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
43462025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
43472025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43482025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43492025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
43502025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43512025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
43522025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43532025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
43542025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43552025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
43562025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43572025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
43582025-07-01T00:19:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43592025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
43602025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43612025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43622025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
43632025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43642025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
43652025-07-01T00:19:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
43662025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43672025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
43682025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43692025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
43702025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43712025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43722025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
43732025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43742025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
43752025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43762025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43772025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43782025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43792025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43802025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43812025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43822025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43832025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43842025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43852025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43862025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43872025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43882025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43892025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43902025-07-01T00:19:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43912025-07-01T00:19:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43922025-07-01T00:19:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43932025-07-01T00:19:23.904ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:09:23.901065346 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43942025-07-01T00:19:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.155787ms iteration = 9 status = {"expiration":"2025-07-01T00:09:23.901065346Z","pruned":[]}
43952025-07-01T00:19:23.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 730694747 } })
43962025-07-01T00:19:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.193445ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43972025-07-01T00:19:23.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
43982025-07-01T00:19:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 731686344 } })
43992025-07-01T00:19:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
44002025-07-01T00:19:23.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012025-07-01T00:19:23.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022025-07-01T00:19:23.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44032025-07-01T00:19:23.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042025-07-01T00:19:23.910ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052025-07-01T00:19:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44062025-07-01T00:19:23.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44072025-07-01T00:19:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44082025-07-01T00:19:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44092025-07-01T00:19:23.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44102025-07-01T00:19:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44112025-07-01T00:19:23.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
44132025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
44142025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44152025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
44162025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44172025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 9 reason = Timeout
44182025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
44192025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 9 reason = Timeout
44202025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
44212025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
44222025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44232025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
44242025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
44252025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
44262025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44272025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
44282025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44292025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 17 reason = Timeout
44302025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
44312025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44322025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44332025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44342025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44352025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44362025-07-01T00:19:23.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 739132998 } })
44372025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
44382025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
44392025-07-01T00:19:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
44402025-07-01T00:19:23.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44412025-07-01T00:19:23.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44422025-07-01T00:19:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44432025-07-01T00:19:23.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44442025-07-01T00:19:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44452025-07-01T00:19:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44462025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44472025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44482025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.225321ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
44492025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44502025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44512025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44522025-07-01T00:19:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44532025-07-01T00:19:23.963ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44542025-07-01T00:19:23.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44552025-07-01T00:19:23.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44562025-07-01T00:19:23.966ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
44572025-07-01T00:19:23.966ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 52.929789ms iteration = 9 status = {"by_rx":{},"error":null}
44582025-07-01T00:19:23.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44592025-07-01T00:19:23.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44602025-07-01T00:19:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44612025-07-01T00:19:23.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622025-07-01T00:19:23.967ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44632025-07-01T00:19:23.967ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44642025-07-01T00:19:23.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44652025-07-01T00:19:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44662025-07-01T00:19:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44672025-07-01T00:19:23.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682025-07-01T00:19:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44692025-07-01T00:19:23.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44702025-07-01T00:19:23.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44712025-07-01T00:19:23.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44722025-07-01T00:19:23.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44732025-07-01T00:19:23.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44742025-07-01T00:19:23.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44752025-07-01T00:19:23.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44762025-07-01T00:19:23.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44772025-07-01T00:19:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44782025-07-01T00:19:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44792025-07-01T00:19:23.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802025-07-01T00:19:23.973ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44812025-07-01T00:19:23.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44822025-07-01T00:19:23.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44832025-07-01T00:19:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44842025-07-01T00:19:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44852025-07-01T00:19:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44862025-07-01T00:19:23.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44872025-07-01T00:19:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44882025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44892025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44902025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44912025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44922025-07-01T00:19:23.976ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44932025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44942025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.187673ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44952025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44962025-07-01T00:19:23.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44972025-07-01T00:19:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44982025-07-01T00:19:23.977ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
44992025-07-01T00:19:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
45002025-07-01T00:19:23.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 13b0f82c-dd2d-40a2-8048-cf13a9e4ca38 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
45012025-07-01T00:19:23.978ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45022025-07-01T00:19:23.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 13b0f82c-dd2d-40a2-8048-cf13a9e4ca38 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
45032025-07-01T00:19:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45042025-07-01T00:19:23.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.679038ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45052025-07-01T00:19:23.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45062025-07-01T00:19:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45072025-07-01T00:19:23.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082025-07-01T00:19:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.495854ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
45092025-07-01T00:19:23.982ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 807550350 } })
45102025-07-01T00:19:23.982ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 69.032189ms iteration = 9 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
45112025-07-01T00:19:23.982ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
45122025-07-01T00:19:23.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 13b0f82c-dd2d-40a2-8048-cf13a9e4ca38 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
45132025-07-01T00:19:23.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45142025-07-01T00:19:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45152025-07-01T00:19:23.986ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45162025-07-01T00:19:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45172025-07-01T00:19:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
45182025-07-01T00:19:23.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45192025-07-01T00:19:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45202025-07-01T00:19:23.991ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.386538ms iteration = 17 status = 0
45212025-07-01T00:19:23.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.207457ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
45222025-07-01T00:19:24.008ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 95.124702ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
45232025-07-01T00:19:24.010ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45242025-07-01T00:19:24.010ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45252025-07-01T00:19:24.010ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45262025-07-01T00:19:24.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45272025-07-01T00:19:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45282025-07-01T00:19:24.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292025-07-01T00:19:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45302025-07-01T00:19:24.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45312025-07-01T00:19:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45322025-07-01T00:19:24.019ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45332025-07-01T00:19:24.019ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.556349ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45342025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45352025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45362025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45372025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45382025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45392025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45402025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45412025-07-01T00:19:24.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45422025-07-01T00:19:24.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45432025-07-01T00:19:24.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442025-07-01T00:19:24.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452025-07-01T00:19:24.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45462025-07-01T00:19:24.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.777466ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45472025-07-01T00:19:24.032ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45482025-07-01T00:19:24.032ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45492025-07-01T00:19:24.032ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45502025-07-01T00:19:24.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45512025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45522025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45532025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45542025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45552025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45562025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45572025-07-01T00:19:24.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45582025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45592025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45602025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45612025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45622025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45632025-07-01T00:19:24.034ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
45642025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 131.477897ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45652025-07-01T00:19:24.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.560036ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45662025-07-01T00:19:24.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.426679ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45672025-07-01T00:19:24.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45682025-07-01T00:19:24.037ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
45692025-07-01T00:19:24.037ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45702025-07-01T00:19:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45712025-07-01T00:19:24.037ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
45722025-07-01T00:19:24.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 136.286238ms iteration = 9 status = {"generation":1}
45732025-07-01T00:19:24.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45742025-07-01T00:19:24.038ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45752025-07-01T00:19:24.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45762025-07-01T00:19:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45772025-07-01T00:19:24.042ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45782025-07-01T00:19:24.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45792025-07-01T00:19:24.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45802025-07-01T00:19:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45812025-07-01T00:19:24.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45822025-07-01T00:19:24.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
45832025-07-01T00:19:24.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45842025-07-01T00:19:24.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45852025-07-01T00:19:24.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
45862025-07-01T00:19:24.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 152.587324ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
45872025-07-01T00:19:24.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45882025-07-01T00:19:24.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45892025-07-01T00:19:24.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
45902025-07-01T00:19:24.065ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45912025-07-01T00:19:24.065ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22139df7-d219-4d11-8722-f1d87290aa6e", "content-length": "26", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
45922025-07-01T00:19:24.065ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45932025-07-01T00:19:24.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45942025-07-01T00:19:24.071ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45952025-07-01T00:19:24.071ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45962025-07-01T00:19:24.071ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.378247ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45972025-07-01T00:19:24.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45982025-07-01T00:19:24.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45992025-07-01T00:19:24.081ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46002025-07-01T00:19:24.081ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
46012025-07-01T00:19:24.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46022025-07-01T00:19:24.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46032025-07-01T00:19:24.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042025-07-01T00:19:24.085ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
46052025-07-01T00:19:24.085ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 182.205915ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46062025-07-01T00:19:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46072025-07-01T00:19:24.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46082025-07-01T00:19:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46092025-07-01T00:19:24.089ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
46102025-07-01T00:19:24.089ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46112025-07-01T00:19:24.089ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
46122025-07-01T00:19:24.089ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 188.737044ms iteration = 9 status = {"generation":2}
46132025-07-01T00:19:24.094ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
46142025-07-01T00:19:24.094ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 193.474223ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46152025-07-01T00:19:24.097ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46162025-07-01T00:19:24.187ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 284.677118ms iteration = 19 status = {"physical_disks_added":0}
46172025-07-01T00:19:24.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46182025-07-01T00:19:24.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46192025-07-01T00:19:24.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46202025-07-01T00:19:24.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46212025-07-01T00:19:24.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46222025-07-01T00:19:24.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46232025-07-01T00:19:24.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46242025-07-01T00:19:24.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46252025-07-01T00:19:24.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46262025-07-01T00:19:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46272025-07-01T00:19:24.236ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
46282025-07-01T00:19:24.236ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "995261ae-2301-4354-b99e-c980c82a0b1b", "content-length": "78", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46292025-07-01T00:19:24.236ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
46302025-07-01T00:19:24.236ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
46312025-07-01T00:19:24.236ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
46322025-07-01T00:19:24.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
46332025-07-01T00:19:24.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
46342025-07-01T00:19:24.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
46352025-07-01T00:19:24.238ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
46362025-07-01T00:19:24.240ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
46372025-07-01T00:19:24.240ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
46382025-07-01T00:19:24.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
46392025-07-01T00:19:24.241ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
46402025-07-01T00:19:24.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
46412025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
46422025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
46432025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
46442025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
46452025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
46462025-07-01T00:19:24.244ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
46472025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 341.39694ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46482025-07-01T00:19:24.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
46492025-07-01T00:19:24.269ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46502025-07-01T00:19:24.278ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
46512025-07-01T00:19:24.278ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
46522025-07-01T00:19:24.278ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "81d2c425-e97e-48fc-821d-cb9338161005", "content-length": "81", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46532025-07-01T00:19:24.290ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
46542025-07-01T00:19:24.290ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
46552025-07-01T00:19:24.291ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfe48798-70bb-42c9-9914-1cf3efc7e630", "content-length": "81", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46562025-07-01T00:19:24.304ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
46572025-07-01T00:19:24.304ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
46582025-07-01T00:19:24.304ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0da534-0202-438f-86ed-2398da5a90a5", "content-length": "81", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46592025-07-01T00:19:24.307ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 394.549055ms iteration = 17 status = {"errors":[],"sps":[]}
46602025-07-01T00:19:24.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
46612025-07-01T00:19:24.324ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46622025-07-01T00:19:24.324ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "60ab4ac1-eac1-4969-a877-a0903e756319", "content-length": "26", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46632025-07-01T00:19:24.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46642025-07-01T00:19:24.327ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
46652025-07-01T00:19:24.331ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
46662025-07-01T00:19:24.331ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46672025-07-01T00:19:24.331ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46682025-07-01T00:19:24.331ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46692025-07-01T00:19:24.331ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6707321-2661-4358-9e46-88be6ed896dd", "content-length": "26", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46702025-07-01T00:19:24.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46712025-07-01T00:19:24.332ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c4d9c2-1db7-49c4-aeaf-c853c76d3393", "content-length": "372", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46722025-07-01T00:19:24.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46732025-07-01T00:19:24.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46742025-07-01T00:19:24.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46752025-07-01T00:19:24.346ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46762025-07-01T00:19:24.346ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46772025-07-01T00:19:24.346ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c2390fb3-5cc8-4769-a81b-b5c709b51f60", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46782025-07-01T00:19:24.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46792025-07-01T00:19:24.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46802025-07-01T00:19:24.347ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46812025-07-01T00:19:24.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46822025-07-01T00:19:24.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46832025-07-01T00:19:24.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46842025-07-01T00:19:24.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46852025-07-01T00:19:24.356ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46862025-07-01T00:19:24.356ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46872025-07-01T00:19:24.356ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ea4c3e15-8d32-47b6-b950-986c0fe299f9", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46882025-07-01T00:19:24.358ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 455.309396ms iteration = 17 status = {}
46892025-07-01T00:19:24.396ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46902025-07-01T00:19:24.396ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86f18eb7-f9dd-481f-a4d0-54990a60e8a1", "content-length": "691", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
46912025-07-01T00:19:24.397ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46922025-07-01T00:19:24.397ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46932025-07-01T00:19:24.397ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46942025-07-01T00:19:24.398ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 495.6227ms iteration = 17 status = {}
46952025-07-01T00:19:24.420ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46962025-07-01T00:19:24.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46972025-07-01T00:19:24.423ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 522.010791ms iteration = 17 status = null
46982025-07-01T00:19:24.466ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 565.565823ms iteration = 17 status = {}
46992025-07-01T00:19:24.472ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47002025-07-01T00:19:24.472ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "de866f0f-8e06-46cd-876a-fc157e4911bd", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47012025-07-01T00:19:24.472ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47022025-07-01T00:19:24.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47032025-07-01T00:19:24.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0d2334e8-b274-4a07-9ffe-1f7011820f3c", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47042025-07-01T00:19:24.475ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47052025-07-01T00:19:24.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "20c3cfee-0178-485e-8803-8fc23d99061b", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47062025-07-01T00:19:24.475ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47072025-07-01T00:19:24.477ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47082025-07-01T00:19:24.477ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 576.717148ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
47092025-07-01T00:19:24.477ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fbcc670e-cdbf-4512-b37b-17ac29f39fe6", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47102025-07-01T00:19:24.477ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47112025-07-01T00:19:24.479ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f91d7408-0111-4e2a-8028-7ede1592a9bc", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47122025-07-01T00:19:24.479ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47132025-07-01T00:19:24.481ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47142025-07-01T00:19:24.481ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 580.538832ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
47152025-07-01T00:19:24.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47162025-07-01T00:19:24.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47172025-07-01T00:19:24.542ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
47182025-07-01T00:19:24.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47192025-07-01T00:19:24.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47202025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
47212025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
47222025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47232025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47242025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47252025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47262025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47272025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47282025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47292025-07-01T00:19:24.555ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47302025-07-01T00:19:24.556ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
47312025-07-01T00:19:24.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47322025-07-01T00:19:24.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47332025-07-01T00:19:24.558ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
47342025-07-01T00:19:24.558ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47352025-07-01T00:19:24.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3d91e2a6-1909-4ea3-8e78-b00ee3c1e1fb", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
47362025-07-01T00:19:24.659ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
47372025-07-01T00:19:24.659ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47382025-07-01T00:19:24.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3df4650-09c0-436c-bef7-ff9b5400556e", "content-length": "682", "date": "Tue, 01 Jul 2025 00:19:24 GMT"} })
47392025-07-01T00:19:24.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47402025-07-01T00:19:24.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47412025-07-01T00:19:24.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47422025-07-01T00:19:24.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47432025-07-01T00:19:24.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47442025-07-01T00:19:24.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47452025-07-01T00:19:24.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47462025-07-01T00:19:24.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47472025-07-01T00:19:24.675ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 772.839373ms iteration = 17 status = {}
47482025-07-01T00:19:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = c3c81e86-de99-45da-ba02-ed3c4bc87fa3 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
47492025-07-01T00:19:25.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe7ee654-9244-4a36-ac84-e99092ed37af roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47502025-07-01T00:19:25.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe7ee654-9244-4a36-ac84-e99092ed37af resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47512025-07-01T00:19:25.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe7ee654-9244-4a36-ac84-e99092ed37af response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47522025-07-01T00:19:26.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a73972c2-acac-449c-abe6-2c37a77aeb8d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47532025-07-01T00:19:26.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a73972c2-acac-449c-abe6-2c37a77aeb8d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47542025-07-01T00:19:26.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a73972c2-acac-449c-abe6-2c37a77aeb8d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47552025-07-01T00:19:27.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cee454ed-afb9-42fd-8af5-3243f0172c93 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47562025-07-01T00:19:27.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cee454ed-afb9-42fd-8af5-3243f0172c93 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47572025-07-01T00:19:27.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1826 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cee454ed-afb9-42fd-8af5-3243f0172c93 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47582025-07-01T00:19:28.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 34e48ed5-ad55-4848-a4f5-a15193df11d4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47592025-07-01T00:19:28.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 34e48ed5-ad55-4848-a4f5-a15193df11d4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47602025-07-01T00:19:28.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 34e48ed5-ad55-4848-a4f5-a15193df11d4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47612025-07-01T00:19:29.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d4842b29-9554-4608-b3c5-ad23547ff916 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47622025-07-01T00:19:29.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d4842b29-9554-4608-b3c5-ad23547ff916 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47632025-07-01T00:19:29.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d4842b29-9554-4608-b3c5-ad23547ff916 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47642025-07-01T00:19:30.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab583f1f-b983-4824-aebc-048729bc1a60 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47652025-07-01T00:19:30.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab583f1f-b983-4824-aebc-048729bc1a60 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47662025-07-01T00:19:30.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab583f1f-b983-4824-aebc-048729bc1a60 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47672025-07-01T00:19:31.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c7ce7a99-b360-4cec-8b49-187c6e143b1c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47682025-07-01T00:19:31.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c7ce7a99-b360-4cec-8b49-187c6e143b1c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47692025-07-01T00:19:31.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c7ce7a99-b360-4cec-8b49-187c6e143b1c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47702025-07-01T00:19:32.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d271ebb3-716a-4cec-aec7-eb874ac4cd2f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47712025-07-01T00:19:32.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d271ebb3-716a-4cec-aec7-eb874ac4cd2f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47722025-07-01T00:19:32.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d271ebb3-716a-4cec-aec7-eb874ac4cd2f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47732025-07-01T00:19:33.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27cfd1a4-9548-4883-87dd-b24c56f1dafe roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47742025-07-01T00:19:33.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27cfd1a4-9548-4883-87dd-b24c56f1dafe resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47752025-07-01T00:19:33.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27cfd1a4-9548-4883-87dd-b24c56f1dafe response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47762025-07-01T00:19:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
47772025-07-01T00:19:33.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
47782025-07-01T00:19:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47792025-07-01T00:19:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47802025-07-01T00:19:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47812025-07-01T00:19:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47822025-07-01T00:19:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832025-07-01T00:19:33.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47842025-07-01T00:19:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47852025-07-01T00:19:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.966879ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47862025-07-01T00:19:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47872025-07-01T00:19:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47882025-07-01T00:19:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47892025-07-01T00:19:33.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47902025-07-01T00:19:33.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47912025-07-01T00:19:33.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47922025-07-01T00:19:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
47932025-07-01T00:19:33.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47942025-07-01T00:19:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47952025-07-01T00:19:33.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
47962025-07-01T00:19:33.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.007435ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
47972025-07-01T00:19:34.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd16cbbb-03cb-4934-afcd-290043f71b26 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47982025-07-01T00:19:34.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd16cbbb-03cb-4934-afcd-290043f71b26 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
47992025-07-01T00:19:34.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd16cbbb-03cb-4934-afcd-290043f71b26 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48002025-07-01T00:19:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 96031a3b-c727-46c6-bfc9-d1dbf41d34ae response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
48012025-07-01T00:19:35.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd53a6c0-34f1-4786-bf5c-cf97c52fe4f7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48022025-07-01T00:19:35.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd53a6c0-34f1-4786-bf5c-cf97c52fe4f7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48032025-07-01T00:19:35.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd53a6c0-34f1-4786-bf5c-cf97c52fe4f7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48042025-07-01T00:19:36.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ede55c0-f743-4908-8b2b-0469e6d4acca roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48052025-07-01T00:19:36.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ede55c0-f743-4908-8b2b-0469e6d4acca resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48062025-07-01T00:19:36.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1688 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ede55c0-f743-4908-8b2b-0469e6d4acca response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48072025-07-01T00:19:37.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 75883a19-0cde-4bcf-8b61-8801175f24bf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48082025-07-01T00:19:37.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 75883a19-0cde-4bcf-8b61-8801175f24bf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48092025-07-01T00:19:37.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 75883a19-0cde-4bcf-8b61-8801175f24bf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48102025-07-01T00:19:38.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7f035df9-dfb8-465a-93db-8b62bdc2bf3d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48112025-07-01T00:19:38.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7f035df9-dfb8-465a-93db-8b62bdc2bf3d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48122025-07-01T00:19:38.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7f035df9-dfb8-465a-93db-8b62bdc2bf3d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48132025-07-01T00:19:39.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b0e7091f-93d0-475e-98c6-543eb9c07b66 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48142025-07-01T00:19:39.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b0e7091f-93d0-475e-98c6-543eb9c07b66 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48152025-07-01T00:19:39.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b0e7091f-93d0-475e-98c6-543eb9c07b66 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48162025-07-01T00:19:40.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8d7689e0-5b88-4f14-b780-78e0d7db5d6b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48172025-07-01T00:19:40.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8d7689e0-5b88-4f14-b780-78e0d7db5d6b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48182025-07-01T00:19:40.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8d7689e0-5b88-4f14-b780-78e0d7db5d6b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48192025-07-01T00:19:41.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c23655e7-c89b-4c5b-a7e1-d032d416294d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48202025-07-01T00:19:41.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c23655e7-c89b-4c5b-a7e1-d032d416294d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48212025-07-01T00:19:41.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1531 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c23655e7-c89b-4c5b-a7e1-d032d416294d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48222025-07-01T00:19:42.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2560f11d-6c10-4beb-867d-663e24105009 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48232025-07-01T00:19:42.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2560f11d-6c10-4beb-867d-663e24105009 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48242025-07-01T00:19:42.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2560f11d-6c10-4beb-867d-663e24105009 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48252025-07-01T00:19:43.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3725c0a4-f769-4658-8ec2-68aee1709720 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48262025-07-01T00:19:43.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3725c0a4-f769-4658-8ec2-68aee1709720 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48272025-07-01T00:19:43.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3725c0a4-f769-4658-8ec2-68aee1709720 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48282025-07-01T00:19:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
48292025-07-01T00:19:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48302025-07-01T00:19:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
48312025-07-01T00:19:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48322025-07-01T00:19:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48332025-07-01T00:19:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48342025-07-01T00:19:43.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48352025-07-01T00:19:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48362025-07-01T00:19:43.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48372025-07-01T00:19:43.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48382025-07-01T00:19:43.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48392025-07-01T00:19:43.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48402025-07-01T00:19:43.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48412025-07-01T00:19:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48422025-07-01T00:19:43.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48432025-07-01T00:19:43.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
48442025-07-01T00:19:43.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48452025-07-01T00:19:43.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48462025-07-01T00:19:43.930ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
48472025-07-01T00:19:43.930ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.479272ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
48482025-07-01T00:19:43.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.547547ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48492025-07-01T00:19:44.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 677a2d70-1b98-40ed-8393-84d1b34357aa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48502025-07-01T00:19:44.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 677a2d70-1b98-40ed-8393-84d1b34357aa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48512025-07-01T00:19:44.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 677a2d70-1b98-40ed-8393-84d1b34357aa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48522025-07-01T00:19:44.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 471 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 7b215a3e-06dc-4fa3-8076-c991717cdcfb response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
48532025-07-01T00:19:45.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69070d5f-9efc-46dd-ac27-d4ea50ffdb90 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48542025-07-01T00:19:45.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69070d5f-9efc-46dd-ac27-d4ea50ffdb90 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48552025-07-01T00:19:45.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 69070d5f-9efc-46dd-ac27-d4ea50ffdb90 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48562025-07-01T00:19:46.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 910d3ad7-dc87-485c-9df3-e0b4de0dcc18 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48572025-07-01T00:19:46.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 910d3ad7-dc87-485c-9df3-e0b4de0dcc18 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48582025-07-01T00:19:46.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 910d3ad7-dc87-485c-9df3-e0b4de0dcc18 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48592025-07-01T00:19:47.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ea412c89-6c23-4eb8-810b-e328c4e3db9c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48602025-07-01T00:19:47.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ea412c89-6c23-4eb8-810b-e328c4e3db9c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48612025-07-01T00:19:47.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ea412c89-6c23-4eb8-810b-e328c4e3db9c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48622025-07-01T00:19:48.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e090959f-fdf4-4ad5-b292-3bad3941de81 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48632025-07-01T00:19:48.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e090959f-fdf4-4ad5-b292-3bad3941de81 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48642025-07-01T00:19:48.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e090959f-fdf4-4ad5-b292-3bad3941de81 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48652025-07-01T00:19:49.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cd9335cc-3f62-4345-9d20-72758c3188f0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48662025-07-01T00:19:49.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cd9335cc-3f62-4345-9d20-72758c3188f0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48672025-07-01T00:19:49.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cd9335cc-3f62-4345-9d20-72758c3188f0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48682025-07-01T00:19:50.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9a0434db-fd44-4f09-96e1-03f4504fde87 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48692025-07-01T00:19:50.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9a0434db-fd44-4f09-96e1-03f4504fde87 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48702025-07-01T00:19:50.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1658 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9a0434db-fd44-4f09-96e1-03f4504fde87 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48712025-07-01T00:19:51.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a44d6bee-b23a-4a0d-9164-c2c43854fcf7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48722025-07-01T00:19:51.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a44d6bee-b23a-4a0d-9164-c2c43854fcf7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48732025-07-01T00:19:51.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a44d6bee-b23a-4a0d-9164-c2c43854fcf7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48742025-07-01T00:19:52.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 473f38f7-4dd9-4082-9c83-18489042c66d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48752025-07-01T00:19:52.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 473f38f7-4dd9-4082-9c83-18489042c66d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48762025-07-01T00:19:52.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 473f38f7-4dd9-4082-9c83-18489042c66d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48772025-07-01T00:19:53.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 783f7829-d280-41c7-8e65-aa1bc5c1145b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48782025-07-01T00:19:53.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 783f7829-d280-41c7-8e65-aa1bc5c1145b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48792025-07-01T00:19:53.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 783f7829-d280-41c7-8e65-aa1bc5c1145b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
48802025-07-01T00:19:53.900ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
48812025-07-01T00:19:53.900ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
48822025-07-01T00:19:53.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48832025-07-01T00:19:53.900ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
48842025-07-01T00:19:53.900ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48852025-07-01T00:19:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48862025-07-01T00:19:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48872025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
48882025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48892025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
48902025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48912025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
48922025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
48932025-07-01T00:19:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48942025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48952025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
48962025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48972025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48982025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
48992025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49002025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
49012025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
49022025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49032025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
49042025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49052025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49062025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
49072025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49082025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
49092025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49102025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49112025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49122025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49132025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49142025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49152025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49162025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49172025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49182025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49192025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49202025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49212025-07-01T00:19:53.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 729158765 } })
49222025-07-01T00:19:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49232025-07-01T00:19:53.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 729178236 } })
49242025-07-01T00:19:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
49252025-07-01T00:19:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
49262025-07-01T00:19:53.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.462065ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49272025-07-01T00:19:53.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49282025-07-01T00:19:53.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49292025-07-01T00:19:53.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302025-07-01T00:19:53.907ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312025-07-01T00:19:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49322025-07-01T00:19:53.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49332025-07-01T00:19:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49342025-07-01T00:19:53.908ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49352025-07-01T00:19:53.908ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49362025-07-01T00:19:53.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49372025-07-01T00:19:53.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49382025-07-01T00:19:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49392025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49402025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49412025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49422025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49432025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49442025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49452025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49462025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49472025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49482025-07-01T00:19:53.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49492025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49502025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49512025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49522025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
49532025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
49542025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49552025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49562025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
49572025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49582025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
49592025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49602025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 18 reason = Timeout
49612025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
49622025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
49632025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49642025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49652025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49662025-07-01T00:19:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49672025-07-01T00:19:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49682025-07-01T00:19:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49692025-07-01T00:19:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49702025-07-01T00:19:53.914ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 739454887 } })
49712025-07-01T00:19:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
49722025-07-01T00:19:53.914ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 739873729 } })
49732025-07-01T00:19:53.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742025-07-01T00:19:53.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
49752025-07-01T00:19:53.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49762025-07-01T00:19:53.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49772025-07-01T00:19:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49782025-07-01T00:19:53.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.114252ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
49792025-07-01T00:19:53.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49802025-07-01T00:19:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49812025-07-01T00:19:53.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49822025-07-01T00:19:53.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49832025-07-01T00:19:53.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49842025-07-01T00:19:53.966ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49852025-07-01T00:19:53.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49862025-07-01T00:19:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49872025-07-01T00:19:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49882025-07-01T00:19:53.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49892025-07-01T00:19:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49902025-07-01T00:19:53.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.41654ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49912025-07-01T00:19:53.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.501809ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
49922025-07-01T00:19:53.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49932025-07-01T00:19:53.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49942025-07-01T00:19:53.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49952025-07-01T00:19:53.969ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49962025-07-01T00:19:53.969ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49972025-07-01T00:19:53.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49982025-07-01T00:19:53.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49992025-07-01T00:19:53.970ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50002025-07-01T00:19:53.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50012025-07-01T00:19:53.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50022025-07-01T00:19:53.971ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50032025-07-01T00:19:53.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50042025-07-01T00:19:53.972ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50052025-07-01T00:19:53.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50062025-07-01T00:19:53.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50072025-07-01T00:19:53.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50082025-07-01T00:19:53.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50092025-07-01T00:19:53.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.962344ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50102025-07-01T00:19:53.974ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 60.419733ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
50112025-07-01T00:19:53.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50122025-07-01T00:19:53.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50132025-07-01T00:19:53.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50142025-07-01T00:19:53.974ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50152025-07-01T00:19:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50162025-07-01T00:19:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
50172025-07-01T00:19:53.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50182025-07-01T00:19:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50192025-07-01T00:19:53.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50202025-07-01T00:19:53.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50212025-07-01T00:19:53.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
50222025-07-01T00:19:53.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50232025-07-01T00:19:53.983ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8c104a7-7d8e-4bc8-b620-e86ae14c7a31", "content-length": "26", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50242025-07-01T00:19:53.983ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50252025-07-01T00:19:53.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50262025-07-01T00:19:53.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50272025-07-01T00:19:53.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50282025-07-01T00:19:54.008ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50292025-07-01T00:19:54.008ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50302025-07-01T00:19:54.008ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.133957ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50312025-07-01T00:19:54.008ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50322025-07-01T00:19:54.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50332025-07-01T00:19:54.009ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
50342025-07-01T00:19:54.009ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 106.112283ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
50352025-07-01T00:19:54.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50362025-07-01T00:19:54.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50372025-07-01T00:19:54.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
50382025-07-01T00:19:54.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50392025-07-01T00:19:54.016ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50402025-07-01T00:19:54.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.871608ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50412025-07-01T00:19:54.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50422025-07-01T00:19:54.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
50432025-07-01T00:19:54.017ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50442025-07-01T00:19:54.017ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c40b5382-1791-4b41-afbf-29ee6712066e", "content-length": "26", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50452025-07-01T00:19:54.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50462025-07-01T00:19:54.018ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.538481ms iteration = 18 status = 0
50472025-07-01T00:19:54.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50482025-07-01T00:19:54.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
50492025-07-01T00:19:54.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50502025-07-01T00:19:54.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.62947ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50512025-07-01T00:19:54.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50522025-07-01T00:19:54.025ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
50532025-07-01T00:19:54.025ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1d9a4a-d84a-4cb8-a13b-2ee3c1352fbf", "content-length": "78", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50542025-07-01T00:19:54.025ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
50552025-07-01T00:19:54.025ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
50562025-07-01T00:19:54.025ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
50572025-07-01T00:19:54.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
50582025-07-01T00:19:54.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
50592025-07-01T00:19:54.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
50602025-07-01T00:19:54.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612025-07-01T00:19:54.028ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
50622025-07-01T00:19:54.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50632025-07-01T00:19:54.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50642025-07-01T00:19:54.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50652025-07-01T00:19:54.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
50662025-07-01T00:19:54.031ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
50672025-07-01T00:19:54.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
50682025-07-01T00:19:54.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50692025-07-01T00:19:54.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50702025-07-01T00:19:54.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50712025-07-01T00:19:54.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50722025-07-01T00:19:54.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
50732025-07-01T00:19:54.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.261383ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
50742025-07-01T00:19:54.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.370263ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50752025-07-01T00:19:54.063ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
50762025-07-01T00:19:54.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
50772025-07-01T00:19:54.066ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
50782025-07-01T00:19:54.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
50792025-07-01T00:19:54.066ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
50802025-07-01T00:19:54.066ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
50812025-07-01T00:19:54.066ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "3019959f-351d-47bc-9ad7-3f77dbe5bb7c", "content-length": "81", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50822025-07-01T00:19:54.071ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
50832025-07-01T00:19:54.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
50842025-07-01T00:19:54.073ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
50852025-07-01T00:19:54.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
50862025-07-01T00:19:54.087ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
50872025-07-01T00:19:54.087ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50882025-07-01T00:19:54.087ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4966c1a6-3278-46d6-965a-bc7d801d5719", "content-length": "26", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50892025-07-01T00:19:54.087ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50902025-07-01T00:19:54.089ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
50912025-07-01T00:19:54.100ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.123283ms iteration = 20 status = {"physical_disks_added":0}
50922025-07-01T00:19:54.109ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
50932025-07-01T00:19:54.109ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
50942025-07-01T00:19:54.110ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cf93b58-dede-42d0-a7d7-9fa61a190b83", "content-length": "81", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50952025-07-01T00:19:54.121ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
50962025-07-01T00:19:54.121ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
50972025-07-01T00:19:54.121ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a6f6b31-3d87-4fd5-977a-640052ff483c", "content-length": "81", "date": "Tue, 01 Jul 2025 00:19:53 GMT"} })
50982025-07-01T00:19:54.123ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 210.16001ms iteration = 18 status = {"errors":[],"sps":[]}
50992025-07-01T00:19:54.143ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51002025-07-01T00:19:54.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51012025-07-01T00:19:54.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "78e392ae-f235-46cb-a35b-5a8ef8271ab1", "content-length": "372", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51022025-07-01T00:19:54.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51032025-07-01T00:19:54.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51042025-07-01T00:19:54.204ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51052025-07-01T00:19:54.204ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51062025-07-01T00:19:54.204ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eccfe8a4-7714-4628-81bd-1931d1858ebd", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51072025-07-01T00:19:54.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51082025-07-01T00:19:54.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51092025-07-01T00:19:54.206ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51102025-07-01T00:19:54.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51112025-07-01T00:19:54.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51122025-07-01T00:19:54.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51132025-07-01T00:19:54.209ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 308.154491ms iteration = 18 status = null
51142025-07-01T00:19:54.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51152025-07-01T00:19:54.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51162025-07-01T00:19:54.214ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51172025-07-01T00:19:54.214ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51182025-07-01T00:19:54.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "210ab859-66e0-4911-8252-949bfa6a5cf3", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51192025-07-01T00:19:54.217ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.780005ms iteration = 18 status = {}
51202025-07-01T00:19:54.246ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.136123ms iteration = 18 status = {}
51212025-07-01T00:19:54.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51222025-07-01T00:19:54.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "979508ef-35c7-4381-8254-599cff997e23", "content-length": "691", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51232025-07-01T00:19:54.264ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51242025-07-01T00:19:54.264ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51252025-07-01T00:19:54.264ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51262025-07-01T00:19:54.266ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.195017ms iteration = 18 status = {}
51272025-07-01T00:19:54.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51282025-07-01T00:19:54.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51292025-07-01T00:19:54.333ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
51302025-07-01T00:19:54.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51312025-07-01T00:19:54.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51322025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
51332025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
51342025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51352025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51362025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51372025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51382025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51392025-07-01T00:19:54.348ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51402025-07-01T00:19:54.349ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51412025-07-01T00:19:54.349ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51422025-07-01T00:19:54.349ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
51432025-07-01T00:19:54.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51442025-07-01T00:19:54.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51452025-07-01T00:19:54.352ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
51462025-07-01T00:19:54.352ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51472025-07-01T00:19:54.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0d7d7eba-6110-4187-955d-ea081df9e4f8", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51482025-07-01T00:19:54.467ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
51492025-07-01T00:19:54.467ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51502025-07-01T00:19:54.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "173f0f36-a032-4c6b-9e25-af2d6b027505", "content-length": "682", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51512025-07-01T00:19:54.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51522025-07-01T00:19:54.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51532025-07-01T00:19:54.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51542025-07-01T00:19:54.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51552025-07-01T00:19:54.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ccde555-77d8-4b53-85b2-621993db79fc roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51562025-07-01T00:19:54.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ccde555-77d8-4b53-85b2-621993db79fc resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51572025-07-01T00:19:54.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51582025-07-01T00:19:54.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51592025-07-01T00:19:54.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ccde555-77d8-4b53-85b2-621993db79fc response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51602025-07-01T00:19:54.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51612025-07-01T00:19:54.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51622025-07-01T00:19:54.486ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 582.878727ms iteration = 18 status = {}
51632025-07-01T00:19:54.741ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
51642025-07-01T00:19:54.741ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
51652025-07-01T00:19:54.771ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
51662025-07-01T00:19:54.771ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:43122
51672025-07-01T00:19:54.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:43122 req_id = 8458fadd-497c-48b8-8cc0-299e7211de39 roles = RoleSet { roles: {} } uri = /metrics/producers
51682025-07-01T00:19:54.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:43122 req_id = 8458fadd-497c-48b8-8cc0-299e7211de39 resource = Database result = Ok(()) uri = /metrics/producers
51692025-07-01T00:19:54.817ZINFOnexus: assigned collector to new producer collector_id = a8a4439d-9bed-4df3-9921-c50bfb72fc42 file = nexus/src/app/oximeter.rs:76 producer_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
51702025-07-01T00:19:54.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 45199 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:43122 req_id = 8458fadd-497c-48b8-8cc0-299e7211de39 response_code = 201 uri = /metrics/producers
51712025-07-01T00:19:54.817ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8458fadd-497c-48b8-8cc0-299e7211de39", "content-length": "41", "date": "Tue, 01 Jul 2025 00:19:54 GMT"} })
51722025-07-01T00:19:54.819ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
51732025-07-01T00:19:54.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = d91fdf79-3325-46b7-9162-a80a1a6b5ac8 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
51742025-07-01T00:19:55.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f617dda1-e99f-4ee0-9e92-b40065716c89 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51752025-07-01T00:19:55.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f617dda1-e99f-4ee0-9e92-b40065716c89 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51762025-07-01T00:19:55.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f617dda1-e99f-4ee0-9e92-b40065716c89 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51772025-07-01T00:19:56.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c77b2b84-c1c0-4840-8d55-160541cbf7ea roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51782025-07-01T00:19:56.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c77b2b84-c1c0-4840-8d55-160541cbf7ea resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51792025-07-01T00:19:56.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c77b2b84-c1c0-4840-8d55-160541cbf7ea response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51802025-07-01T00:19:57.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 336cabe4-6d63-444f-8535-222c015f4edf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51812025-07-01T00:19:57.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 336cabe4-6d63-444f-8535-222c015f4edf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51822025-07-01T00:19:57.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 336cabe4-6d63-444f-8535-222c015f4edf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51832025-07-01T00:19:58.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 976095b5-3fa3-4d8e-92e4-a8e70adbe8c5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51842025-07-01T00:19:58.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 976095b5-3fa3-4d8e-92e4-a8e70adbe8c5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51852025-07-01T00:19:58.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 976095b5-3fa3-4d8e-92e4-a8e70adbe8c5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51862025-07-01T00:19:59.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2b584b12-81f5-43ab-a8a5-cd9703fbba94 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51872025-07-01T00:19:59.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2b584b12-81f5-43ab-a8a5-cd9703fbba94 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51882025-07-01T00:19:59.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2863 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2b584b12-81f5-43ab-a8a5-cd9703fbba94 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51892025-07-01T00:20:00.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 15e096f8-9536-426d-b79b-413839f1fb85 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51902025-07-01T00:20:00.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 15e096f8-9536-426d-b79b-413839f1fb85 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51912025-07-01T00:20:00.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 15e096f8-9536-426d-b79b-413839f1fb85 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51922025-07-01T00:20:01.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d88b8c38-189d-43bc-804b-7818afe350a4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51932025-07-01T00:20:01.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d88b8c38-189d-43bc-804b-7818afe350a4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51942025-07-01T00:20:01.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d88b8c38-189d-43bc-804b-7818afe350a4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51952025-07-01T00:20:02.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ee4e7ee3-8636-4af3-82a3-ff2efd23c2f4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51962025-07-01T00:20:02.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ee4e7ee3-8636-4af3-82a3-ff2efd23c2f4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51972025-07-01T00:20:02.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ee4e7ee3-8636-4af3-82a3-ff2efd23c2f4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51982025-07-01T00:20:03.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b2ea249e-5164-4b7a-94a2-77a0994dbd57 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
51992025-07-01T00:20:03.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b2ea249e-5164-4b7a-94a2-77a0994dbd57 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52002025-07-01T00:20:03.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b2ea249e-5164-4b7a-94a2-77a0994dbd57 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52012025-07-01T00:20:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
52022025-07-01T00:20:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52032025-07-01T00:20:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
52042025-07-01T00:20:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52052025-07-01T00:20:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52062025-07-01T00:20:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52072025-07-01T00:20:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52082025-07-01T00:20:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52092025-07-01T00:20:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52102025-07-01T00:20:03.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52112025-07-01T00:20:03.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52122025-07-01T00:20:03.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52132025-07-01T00:20:03.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52142025-07-01T00:20:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
52152025-07-01T00:20:03.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52162025-07-01T00:20:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52172025-07-01T00:20:03.927ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
52182025-07-01T00:20:03.927ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.174461ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
52192025-07-01T00:20:03.937ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52202025-07-01T00:20:03.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52212025-07-01T00:20:03.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.055532ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52222025-07-01T00:20:04.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f0ddbfb0-e9f5-4190-a136-09f143026135 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52232025-07-01T00:20:04.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f0ddbfb0-e9f5-4190-a136-09f143026135 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52242025-07-01T00:20:04.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f0ddbfb0-e9f5-4190-a136-09f143026135 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52252025-07-01T00:20:04.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:37066
52262025-07-01T00:20:04.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = b4be9669-0984-4dc9-9c8d-5bda17123ed0 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
52272025-07-01T00:20:04.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = b4be9669-0984-4dc9-9c8d-5bda17123ed0 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
52282025-07-01T00:20:04.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2763 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = b4be9669-0984-4dc9-9c8d-5bda17123ed0 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
52292025-07-01T00:20:04.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 241c2886-2cd4-4831-ac29-dd6129562dd7 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
52302025-07-01T00:20:04.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 241c2886-2cd4-4831-ac29-dd6129562dd7 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
52312025-07-01T00:20:04.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 241c2886-2cd4-4831-ac29-dd6129562dd7 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
52322025-07-01T00:20:04.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 476 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 02db3a18-6904-45e6-b18b-318522870c3c response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
52332025-07-01T00:20:05.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 476b8f55-9e31-4c70-ba96-d8f95b23deb0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52342025-07-01T00:20:05.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 476b8f55-9e31-4c70-ba96-d8f95b23deb0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52352025-07-01T00:20:05.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1767 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 476b8f55-9e31-4c70-ba96-d8f95b23deb0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52362025-07-01T00:20:06.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 95a9c67b-a6eb-4508-ad51-44b5d9ab1d97 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52372025-07-01T00:20:06.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 95a9c67b-a6eb-4508-ad51-44b5d9ab1d97 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52382025-07-01T00:20:06.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 95a9c67b-a6eb-4508-ad51-44b5d9ab1d97 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52392025-07-01T00:20:07.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39e75020-bca5-48ed-9c4f-6f781db508a7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52402025-07-01T00:20:07.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39e75020-bca5-48ed-9c4f-6f781db508a7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52412025-07-01T00:20:07.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39e75020-bca5-48ed-9c4f-6f781db508a7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52422025-07-01T00:20:08.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ea7d004a-d696-4ec0-9a53-04f0bd5d572d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52432025-07-01T00:20:08.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ea7d004a-d696-4ec0-9a53-04f0bd5d572d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52442025-07-01T00:20:08.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ea7d004a-d696-4ec0-9a53-04f0bd5d572d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52452025-07-01T00:20:09.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 40cdc55b-8e34-4f8d-8459-048e323a41ee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52462025-07-01T00:20:09.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 40cdc55b-8e34-4f8d-8459-048e323a41ee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52472025-07-01T00:20:09.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 40cdc55b-8e34-4f8d-8459-048e323a41ee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52482025-07-01T00:20:10.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d2c05d5f-20e1-4aa1-9f17-3f89ccc45a61 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52492025-07-01T00:20:10.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d2c05d5f-20e1-4aa1-9f17-3f89ccc45a61 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52502025-07-01T00:20:10.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1893 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d2c05d5f-20e1-4aa1-9f17-3f89ccc45a61 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52512025-07-01T00:20:11.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e9696e8a-0ac7-48fb-a557-c4103d0e0d48 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52522025-07-01T00:20:11.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e9696e8a-0ac7-48fb-a557-c4103d0e0d48 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52532025-07-01T00:20:11.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e9696e8a-0ac7-48fb-a557-c4103d0e0d48 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52542025-07-01T00:20:12.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 17f35d46-77a6-41d1-8a3e-79e3fe4d2168 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52552025-07-01T00:20:12.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 17f35d46-77a6-41d1-8a3e-79e3fe4d2168 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52562025-07-01T00:20:12.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 17f35d46-77a6-41d1-8a3e-79e3fe4d2168 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52572025-07-01T00:20:13.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 929230cc-c377-4fdc-b95d-89f8b2a0c70e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52582025-07-01T00:20:13.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 929230cc-c377-4fdc-b95d-89f8b2a0c70e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52592025-07-01T00:20:13.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 929230cc-c377-4fdc-b95d-89f8b2a0c70e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52602025-07-01T00:20:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
52612025-07-01T00:20:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
52622025-07-01T00:20:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52632025-07-01T00:20:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52642025-07-01T00:20:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52652025-07-01T00:20:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52662025-07-01T00:20:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52672025-07-01T00:20:13.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52682025-07-01T00:20:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52692025-07-01T00:20:13.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.915927ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52702025-07-01T00:20:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52712025-07-01T00:20:13.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52722025-07-01T00:20:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52732025-07-01T00:20:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52742025-07-01T00:20:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52752025-07-01T00:20:13.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762025-07-01T00:20:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
52772025-07-01T00:20:13.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52782025-07-01T00:20:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52792025-07-01T00:20:13.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
52802025-07-01T00:20:13.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.458422ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
52812025-07-01T00:20:14.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55b516f6-f868-4b59-8b0a-522a98bd63e3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52822025-07-01T00:20:14.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55b516f6-f868-4b59-8b0a-522a98bd63e3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52832025-07-01T00:20:14.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 55b516f6-f868-4b59-8b0a-522a98bd63e3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52842025-07-01T00:20:14.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = e0d1a5fe-b3b8-445f-9fbc-bfd3a672a577 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
52852025-07-01T00:20:15.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 268adf28-5a26-488f-8867-02fc9de45dda roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52862025-07-01T00:20:15.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 268adf28-5a26-488f-8867-02fc9de45dda resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52872025-07-01T00:20:15.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1728 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 268adf28-5a26-488f-8867-02fc9de45dda response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52882025-07-01T00:20:16.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f876a35e-032f-4bf1-9304-1f6fcecf69ba roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52892025-07-01T00:20:16.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f876a35e-032f-4bf1-9304-1f6fcecf69ba resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52902025-07-01T00:20:16.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f876a35e-032f-4bf1-9304-1f6fcecf69ba response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52912025-07-01T00:20:17.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4b9df95d-50d5-4d75-979c-06eb4670dffc roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52922025-07-01T00:20:17.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4b9df95d-50d5-4d75-979c-06eb4670dffc resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52932025-07-01T00:20:17.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4b9df95d-50d5-4d75-979c-06eb4670dffc response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52942025-07-01T00:20:18.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c62ad82d-e058-40c0-882e-f9c5e4033f0c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52952025-07-01T00:20:18.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c62ad82d-e058-40c0-882e-f9c5e4033f0c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52962025-07-01T00:20:18.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c62ad82d-e058-40c0-882e-f9c5e4033f0c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52972025-07-01T00:20:19.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8baef91-0692-431e-bf7d-9cf01c4a1680 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52982025-07-01T00:20:19.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8baef91-0692-431e-bf7d-9cf01c4a1680 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
52992025-07-01T00:20:19.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1822 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b8baef91-0692-431e-bf7d-9cf01c4a1680 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53002025-07-01T00:20:20.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1e624aa5-1ed2-4109-b337-9cac2a23a42b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53012025-07-01T00:20:20.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1e624aa5-1ed2-4109-b337-9cac2a23a42b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53022025-07-01T00:20:20.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1e624aa5-1ed2-4109-b337-9cac2a23a42b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53032025-07-01T00:20:21.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5402ac2-2d27-40b8-8d57-df44d039046a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53042025-07-01T00:20:21.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5402ac2-2d27-40b8-8d57-df44d039046a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53052025-07-01T00:20:21.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5402ac2-2d27-40b8-8d57-df44d039046a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53062025-07-01T00:20:22.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9bb10f6c-996d-48c8-a27c-9c7f344367b7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53072025-07-01T00:20:22.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9bb10f6c-996d-48c8-a27c-9c7f344367b7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53082025-07-01T00:20:22.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9bb10f6c-996d-48c8-a27c-9c7f344367b7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
53092025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
53102025-07-01T00:20:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
53112025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.231\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
53122025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
53132025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
53142025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53152025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
53162025-07-01T00:20:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:10:23.901874627 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53172025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
53182025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53192025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53202025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
53212025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53222025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53232025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53242025-07-01T00:20:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
53252025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
53262025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
53272025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53282025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
53292025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53302025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
53312025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
53322025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53332025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53342025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53352025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53362025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53372025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53382025-07-01T00:20:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 727803618 } })
53392025-07-01T00:20:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 727881400 } })
53402025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
53412025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
53422025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53432025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53442025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
53452025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
53462025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53472025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53482025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
53492025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53502025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
53512025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
53522025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53532025-07-01T00:20:23.902ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53542025-07-01T00:20:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53552025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 986.837\u{b5}s iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53562025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53572025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
53582025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
53592025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53602025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53612025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
53622025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53632025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
53642025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53652025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53662025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
53672025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
53682025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53692025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53702025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
53712025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53722025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
53732025-07-01T00:20:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
53742025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53752025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 13 reason = Timeout
53762025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
53772025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.14\u{b5}s iteration = 13 status = "Disabled"
53782025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53792025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53802025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53812025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53822025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
53832025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.340497ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
53842025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53852025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53862025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53872025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53882025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53892025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53902025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53912025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53922025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53932025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53942025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53952025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53962025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53972025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53982025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53992025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54002025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54012025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54022025-07-01T00:20:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54032025-07-01T00:20:23.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042025-07-01T00:20:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.939721ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54052025-07-01T00:20:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54062025-07-01T00:20:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54072025-07-01T00:20:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54082025-07-01T00:20:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54092025-07-01T00:20:23.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:10:23.901874627 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54102025-07-01T00:20:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.071911ms iteration = 10 status = {"expiration":"2025-07-01T00:10:23.901874627Z","pruned":[]}
54112025-07-01T00:20:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 731870660 } })
54122025-07-01T00:20:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
54132025-07-01T00:20:23.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54142025-07-01T00:20:23.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54152025-07-01T00:20:23.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54162025-07-01T00:20:23.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 732526327 } })
54172025-07-01T00:20:23.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
54182025-07-01T00:20:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192025-07-01T00:20:23.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54202025-07-01T00:20:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54212025-07-01T00:20:23.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54222025-07-01T00:20:23.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232025-07-01T00:20:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54242025-07-01T00:20:23.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54252025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
54262025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54272025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
54282025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54292025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
54302025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54312025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
54322025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
54332025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
54342025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
54352025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
54362025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54372025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 19 reason = Timeout
54382025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
54392025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54402025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
54412025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54422025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
54432025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54442025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54452025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54462025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54472025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
54482025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54492025-07-01T00:20:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
54502025-07-01T00:20:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54512025-07-01T00:20:23.914ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 739335404 } })
54522025-07-01T00:20:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54532025-07-01T00:20:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
54542025-07-01T00:20:23.914ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54552025-07-01T00:20:23.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54562025-07-01T00:20:23.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54572025-07-01T00:20:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54582025-07-01T00:20:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54592025-07-01T00:20:23.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54602025-07-01T00:20:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54612025-07-01T00:20:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54622025-07-01T00:20:23.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54632025-07-01T00:20:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54642025-07-01T00:20:23.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54652025-07-01T00:20:23.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54662025-07-01T00:20:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54672025-07-01T00:20:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54682025-07-01T00:20:23.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54692025-07-01T00:20:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54702025-07-01T00:20:23.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54712025-07-01T00:20:23.920ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.5819ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
54722025-07-01T00:20:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54732025-07-01T00:20:23.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54742025-07-01T00:20:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54752025-07-01T00:20:23.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6d62a0a0-c84e-4cb3-9b88-982051fe1000 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
54762025-07-01T00:20:23.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6d62a0a0-c84e-4cb3-9b88-982051fe1000 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
54772025-07-01T00:20:23.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54782025-07-01T00:20:23.961ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54792025-07-01T00:20:23.961ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802025-07-01T00:20:23.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54812025-07-01T00:20:23.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54822025-07-01T00:20:23.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54832025-07-01T00:20:23.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54842025-07-01T00:20:23.964ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54852025-07-01T00:20:23.964ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54862025-07-01T00:20:23.964ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.038001ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54872025-07-01T00:20:23.965ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 790529864 } })
54882025-07-01T00:20:23.965ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54892025-07-01T00:20:23.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54902025-07-01T00:20:23.965ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54912025-07-01T00:20:23.965ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
54922025-07-01T00:20:23.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54932025-07-01T00:20:23.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54942025-07-01T00:20:23.966ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
54952025-07-01T00:20:23.966ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 53.250027ms iteration = 10 status = {"by_rx":{},"error":null}
54962025-07-01T00:20:23.967ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54972025-07-01T00:20:23.967ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54982025-07-01T00:20:23.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54992025-07-01T00:20:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55002025-07-01T00:20:23.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012025-07-01T00:20:23.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55022025-07-01T00:20:23.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55032025-07-01T00:20:23.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55042025-07-01T00:20:23.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55052025-07-01T00:20:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55062025-07-01T00:20:23.973ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55072025-07-01T00:20:23.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55082025-07-01T00:20:23.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55092025-07-01T00:20:23.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102025-07-01T00:20:23.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 32300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6d62a0a0-c84e-4cb3-9b88-982051fe1000 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
55112025-07-01T00:20:23.977ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55122025-07-01T00:20:23.977ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
55132025-07-01T00:20:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
55142025-07-01T00:20:23.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55152025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55162025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55172025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.240086ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55182025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55192025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55202025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55212025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55222025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55232025-07-01T00:20:23.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55242025-07-01T00:20:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55252025-07-01T00:20:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55262025-07-01T00:20:23.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55272025-07-01T00:20:23.980ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55282025-07-01T00:20:23.980ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.327435ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55292025-07-01T00:20:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55302025-07-01T00:20:23.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55312025-07-01T00:20:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 67.758744ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
55322025-07-01T00:20:23.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55332025-07-01T00:20:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55342025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55352025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55362025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55382025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55392025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55402025-07-01T00:20:23.982ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55412025-07-01T00:20:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55422025-07-01T00:20:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55432025-07-01T00:20:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55442025-07-01T00:20:23.984ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55452025-07-01T00:20:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55462025-07-01T00:20:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55472025-07-01T00:20:23.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.444645ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
55482025-07-01T00:20:23.984ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55492025-07-01T00:20:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55502025-07-01T00:20:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
55512025-07-01T00:20:23.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55522025-07-01T00:20:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55532025-07-01T00:20:23.986ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 83.339411ms iteration = 5 status = {"nsuccess":5}
55542025-07-01T00:20:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55552025-07-01T00:20:24.000ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
55562025-07-01T00:20:24.000ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.191668ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
55572025-07-01T00:20:24.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.219102ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
55582025-07-01T00:20:24.022ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55592025-07-01T00:20:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55602025-07-01T00:20:24.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55612025-07-01T00:20:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55622025-07-01T00:20:24.024ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55632025-07-01T00:20:24.024ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55642025-07-01T00:20:24.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55652025-07-01T00:20:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55662025-07-01T00:20:24.025ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 111.607293ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
55672025-07-01T00:20:24.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.372625ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55682025-07-01T00:20:24.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55692025-07-01T00:20:24.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55702025-07-01T00:20:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55712025-07-01T00:20:24.030ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55722025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55732025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55742025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55752025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.504525ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55762025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55772025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55782025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55792025-07-01T00:20:24.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55802025-07-01T00:20:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55812025-07-01T00:20:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55822025-07-01T00:20:24.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55832025-07-01T00:20:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55842025-07-01T00:20:24.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55852025-07-01T00:20:24.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55862025-07-01T00:20:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55872025-07-01T00:20:24.037ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55882025-07-01T00:20:24.037ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55892025-07-01T00:20:24.037ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55902025-07-01T00:20:24.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55912025-07-01T00:20:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55922025-07-01T00:20:24.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55932025-07-01T00:20:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55942025-07-01T00:20:24.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55952025-07-01T00:20:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55962025-07-01T00:20:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55972025-07-01T00:20:24.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55982025-07-01T00:20:24.043ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55992025-07-01T00:20:24.044ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56002025-07-01T00:20:24.044ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56012025-07-01T00:20:24.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56022025-07-01T00:20:24.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56032025-07-01T00:20:24.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56042025-07-01T00:20:24.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56052025-07-01T00:20:24.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56062025-07-01T00:20:24.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.843225ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56072025-07-01T00:20:24.046ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56082025-07-01T00:20:24.046ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
56092025-07-01T00:20:24.046ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.422984ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56102025-07-01T00:20:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
56112025-07-01T00:20:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56122025-07-01T00:20:24.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56132025-07-01T00:20:24.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56142025-07-01T00:20:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56152025-07-01T00:20:24.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56162025-07-01T00:20:24.049ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.263562ms iteration = 19 status = 0
56172025-07-01T00:20:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56182025-07-01T00:20:24.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56192025-07-01T00:20:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56202025-07-01T00:20:24.052ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
56212025-07-01T00:20:24.052ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56222025-07-01T00:20:24.052ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
56232025-07-01T00:20:24.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.240721ms iteration = 10 status = {"generation":1}
56242025-07-01T00:20:24.055ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
56252025-07-01T00:20:24.055ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56262025-07-01T00:20:24.055ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1616ade-fcf6-4b02-a2a4-6b58e0902e5a", "content-length": "26", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
56272025-07-01T00:20:24.055ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56282025-07-01T00:20:24.057ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56292025-07-01T00:20:24.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56302025-07-01T00:20:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56312025-07-01T00:20:24.074ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56322025-07-01T00:20:24.074ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56332025-07-01T00:20:24.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 171.521073ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56342025-07-01T00:20:24.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56352025-07-01T00:20:24.086ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56362025-07-01T00:20:24.086ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
56372025-07-01T00:20:24.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56382025-07-01T00:20:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56392025-07-01T00:20:24.093ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
56402025-07-01T00:20:24.093ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 190.256306ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56412025-07-01T00:20:24.099ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
56422025-07-01T00:20:24.099ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 197.806122ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56432025-07-01T00:20:24.113ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
56442025-07-01T00:20:24.113ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50fb29a-3a94-4755-b0b0-02060e67c6ca", "content-length": "78", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
56452025-07-01T00:20:24.113ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
56462025-07-01T00:20:24.113ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
56472025-07-01T00:20:24.113ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
56482025-07-01T00:20:24.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
56492025-07-01T00:20:24.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
56502025-07-01T00:20:24.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
56512025-07-01T00:20:24.116ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
56522025-07-01T00:20:24.116ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
56532025-07-01T00:20:24.117ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56542025-07-01T00:20:24.117ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
56552025-07-01T00:20:24.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
56562025-07-01T00:20:24.117ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56572025-07-01T00:20:24.118ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b2cb62-500a-4a44-a2d9-242a42c8a465", "content-length": "26", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
56582025-07-01T00:20:24.118ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56592025-07-01T00:20:24.118ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 215.823945ms iteration = 21 status = {"physical_disks_added":0}
56602025-07-01T00:20:24.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
56612025-07-01T00:20:24.119ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
56622025-07-01T00:20:24.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
56632025-07-01T00:20:24.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
56642025-07-01T00:20:24.120ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
56652025-07-01T00:20:24.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
56662025-07-01T00:20:24.120ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56672025-07-01T00:20:24.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
56682025-07-01T00:20:24.121ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
56692025-07-01T00:20:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
56702025-07-01T00:20:24.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56712025-07-01T00:20:24.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
56722025-07-01T00:20:24.126ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56732025-07-01T00:20:24.127ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43d642bd-1a50-4227-b6c8-c9aa860225d1", "content-length": "26", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
56742025-07-01T00:20:24.127ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56752025-07-01T00:20:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56762025-07-01T00:20:24.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56772025-07-01T00:20:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56782025-07-01T00:20:24.129ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
56792025-07-01T00:20:24.133ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
56802025-07-01T00:20:24.133ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56812025-07-01T00:20:24.133ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
56822025-07-01T00:20:24.133ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 229.303394ms iteration = 10 status = {"generation":2}
56832025-07-01T00:20:24.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56842025-07-01T00:20:24.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56852025-07-01T00:20:24.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56862025-07-01T00:20:24.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56872025-07-01T00:20:24.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56882025-07-01T00:20:24.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56892025-07-01T00:20:24.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56902025-07-01T00:20:24.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56912025-07-01T00:20:24.160ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56922025-07-01T00:20:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56932025-07-01T00:20:24.170ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
56942025-07-01T00:20:24.170ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
56952025-07-01T00:20:24.171ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "15685731-b7f0-4aef-8635-85f33820feb3", "content-length": "81", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
56962025-07-01T00:20:24.186ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
56972025-07-01T00:20:24.186ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
56982025-07-01T00:20:24.187ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "695c39a3-937a-4d1f-bb74-5e47513232cc", "content-length": "81", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
56992025-07-01T00:20:24.188ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
57002025-07-01T00:20:24.188ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
57012025-07-01T00:20:24.188ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "58f0477b-236e-48ea-8abe-f865501f316e", "content-length": "81", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57022025-07-01T00:20:24.190ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 276.869005ms iteration = 19 status = {"errors":[],"sps":[]}
57032025-07-01T00:20:24.281ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57042025-07-01T00:20:24.281ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57052025-07-01T00:20:24.282ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0be47351-727d-41fb-84d8-a7812592b0ef", "content-length": "372", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57062025-07-01T00:20:24.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57072025-07-01T00:20:24.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57082025-07-01T00:20:24.287ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
57092025-07-01T00:20:24.287ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 384.276534ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57102025-07-01T00:20:24.338ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57112025-07-01T00:20:24.349ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57122025-07-01T00:20:24.349ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57132025-07-01T00:20:24.349ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e411bffa-69a3-41aa-9810-57b48eddcafa", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57142025-07-01T00:20:24.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57152025-07-01T00:20:24.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57162025-07-01T00:20:24.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57172025-07-01T00:20:24.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57182025-07-01T00:20:24.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57192025-07-01T00:20:24.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57202025-07-01T00:20:24.360ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57212025-07-01T00:20:24.361ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57222025-07-01T00:20:24.361ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae22f8d4-f2e8-403e-a2e0-167f3bbb46ca", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57232025-07-01T00:20:24.363ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.339264ms iteration = 19 status = {}
57242025-07-01T00:20:24.415ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57252025-07-01T00:20:24.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57262025-07-01T00:20:24.418ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 516.143991ms iteration = 19 status = null
57272025-07-01T00:20:24.423ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57282025-07-01T00:20:24.423ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3005a2f1-4523-48df-b01d-570760a7d71b", "content-length": "691", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57292025-07-01T00:20:24.423ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57302025-07-01T00:20:24.423ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57312025-07-01T00:20:24.423ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57322025-07-01T00:20:24.424ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 521.896168ms iteration = 19 status = {}
57332025-07-01T00:20:24.440ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
57342025-07-01T00:20:24.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ed3ce14-f152-4d1d-958c-6fd1f385ab6a", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57352025-07-01T00:20:24.441ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57362025-07-01T00:20:24.443ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 541.594127ms iteration = 19 status = {}
57372025-07-01T00:20:24.444ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4782f10e-b4b1-41f4-98fe-196220157812", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57382025-07-01T00:20:24.444ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57392025-07-01T00:20:24.446ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57402025-07-01T00:20:24.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 544.424984ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57412025-07-01T00:20:24.471ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57422025-07-01T00:20:24.471ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c3dbb578-4132-40f2-b4dc-49cf37af9d22", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57432025-07-01T00:20:24.471ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57442025-07-01T00:20:24.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ca5a46f2-ed01-4987-a526-84a78d4d69b8", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57452025-07-01T00:20:24.473ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57462025-07-01T00:20:24.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "11a63d57-2d7c-4a0e-a7b3-42f10f3bd467", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57472025-07-01T00:20:24.475ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57482025-07-01T00:20:24.477ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57492025-07-01T00:20:24.477ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 575.292259ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57502025-07-01T00:20:24.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57512025-07-01T00:20:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57522025-07-01T00:20:24.536ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
57532025-07-01T00:20:24.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57542025-07-01T00:20:24.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57552025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
57562025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
57572025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57582025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57592025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57602025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57612025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57622025-07-01T00:20:24.549ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57632025-07-01T00:20:24.550ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57642025-07-01T00:20:24.550ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57652025-07-01T00:20:24.550ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
57662025-07-01T00:20:24.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57672025-07-01T00:20:24.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57682025-07-01T00:20:24.552ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
57692025-07-01T00:20:24.553ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57702025-07-01T00:20:24.643ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1b148296-5787-4161-9df5-899b09662d13", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57712025-07-01T00:20:24.643ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
57722025-07-01T00:20:24.643ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57732025-07-01T00:20:24.644ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3333d593-7507-4e78-afe7-ea9dbae7b08e", "content-length": "682", "date": "Tue, 01 Jul 2025 00:20:24 GMT"} })
57742025-07-01T00:20:24.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57752025-07-01T00:20:24.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57762025-07-01T00:20:24.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57772025-07-01T00:20:24.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57782025-07-01T00:20:24.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57792025-07-01T00:20:24.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57802025-07-01T00:20:24.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57812025-07-01T00:20:24.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57822025-07-01T00:20:24.662ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 759.371516ms iteration = 19 status = {}
57832025-07-01T00:20:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = facbad8f-6c05-4c29-8f50-4f99f602e9e1 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
57842025-07-01T00:20:24.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f3cd39e-1aa9-4b69-8182-5032a7328720 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57852025-07-01T00:20:24.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f3cd39e-1aa9-4b69-8182-5032a7328720 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57862025-07-01T00:20:24.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1622 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f3cd39e-1aa9-4b69-8182-5032a7328720 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57872025-07-01T00:20:26.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1b492d78-22ba-48e9-99c7-85b796ed8482 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57882025-07-01T00:20:26.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1b492d78-22ba-48e9-99c7-85b796ed8482 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57892025-07-01T00:20:26.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1b492d78-22ba-48e9-99c7-85b796ed8482 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57902025-07-01T00:20:27.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e32a14ee-3d33-4a57-97fb-f79b3ed5964f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57912025-07-01T00:20:27.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e32a14ee-3d33-4a57-97fb-f79b3ed5964f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57922025-07-01T00:20:27.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e32a14ee-3d33-4a57-97fb-f79b3ed5964f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57932025-07-01T00:20:28.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0b895f4-9d06-42b0-a45d-694f555c3831 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57942025-07-01T00:20:28.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0b895f4-9d06-42b0-a45d-694f555c3831 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57952025-07-01T00:20:28.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d0b895f4-9d06-42b0-a45d-694f555c3831 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57962025-07-01T00:20:29.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 21c547c9-245a-42a5-b4a6-f5ad8910ff5f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57972025-07-01T00:20:29.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 21c547c9-245a-42a5-b4a6-f5ad8910ff5f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57982025-07-01T00:20:29.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 21c547c9-245a-42a5-b4a6-f5ad8910ff5f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
57992025-07-01T00:20:30.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7dd9870c-4f91-4887-965d-cc7a39c241a9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58002025-07-01T00:20:30.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7dd9870c-4f91-4887-965d-cc7a39c241a9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58012025-07-01T00:20:30.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7dd9870c-4f91-4887-965d-cc7a39c241a9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58022025-07-01T00:20:31.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 32f36977-b5ea-4644-af59-b5589988aba6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58032025-07-01T00:20:31.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 32f36977-b5ea-4644-af59-b5589988aba6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58042025-07-01T00:20:31.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 32f36977-b5ea-4644-af59-b5589988aba6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58052025-07-01T00:20:32.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4e1283ac-2f56-47c9-adb4-f25b1705ec4c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58062025-07-01T00:20:32.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4e1283ac-2f56-47c9-adb4-f25b1705ec4c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58072025-07-01T00:20:32.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4e1283ac-2f56-47c9-adb4-f25b1705ec4c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58082025-07-01T00:20:33.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 121e05e3-b427-4c24-81bb-eb22ced56b51 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58092025-07-01T00:20:33.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 121e05e3-b427-4c24-81bb-eb22ced56b51 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58102025-07-01T00:20:33.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 121e05e3-b427-4c24-81bb-eb22ced56b51 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58112025-07-01T00:20:33.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
58122025-07-01T00:20:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58132025-07-01T00:20:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
58142025-07-01T00:20:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58152025-07-01T00:20:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58162025-07-01T00:20:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58172025-07-01T00:20:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58182025-07-01T00:20:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58192025-07-01T00:20:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58202025-07-01T00:20:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58212025-07-01T00:20:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58222025-07-01T00:20:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58232025-07-01T00:20:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58242025-07-01T00:20:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
58252025-07-01T00:20:33.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58262025-07-01T00:20:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58272025-07-01T00:20:33.927ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
58282025-07-01T00:20:33.927ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.938455ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
58292025-07-01T00:20:33.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58302025-07-01T00:20:33.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58312025-07-01T00:20:33.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.504631ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58322025-07-01T00:20:34.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c0fc801a-9210-428c-859e-c21a9f85b9eb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58332025-07-01T00:20:34.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c0fc801a-9210-428c-859e-c21a9f85b9eb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58342025-07-01T00:20:34.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c0fc801a-9210-428c-859e-c21a9f85b9eb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58352025-07-01T00:20:34.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = decdc985-d632-416f-a064-c6df8417c7bd roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
58362025-07-01T00:20:34.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = decdc985-d632-416f-a064-c6df8417c7bd resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
58372025-07-01T00:20:34.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = decdc985-d632-416f-a064-c6df8417c7bd response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
58382025-07-01T00:20:34.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 33123877-1b36-4262-a0b6-e52bd811f662 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
58392025-07-01T00:20:34.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 33123877-1b36-4262-a0b6-e52bd811f662 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
58402025-07-01T00:20:34.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 33123877-1b36-4262-a0b6-e52bd811f662 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
58412025-07-01T00:20:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 425 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 0d5a156c-5bc2-4768-b71d-7b402f2de40e response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
58422025-07-01T00:20:35.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7073ba0d-d36e-4ea3-bc6a-3108261fbebd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58432025-07-01T00:20:35.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7073ba0d-d36e-4ea3-bc6a-3108261fbebd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58442025-07-01T00:20:35.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2692 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7073ba0d-d36e-4ea3-bc6a-3108261fbebd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58452025-07-01T00:20:36.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 886964c2-277e-4cf9-9403-4667ebcf7377 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58462025-07-01T00:20:36.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 886964c2-277e-4cf9-9403-4667ebcf7377 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58472025-07-01T00:20:36.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 886964c2-277e-4cf9-9403-4667ebcf7377 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58482025-07-01T00:20:37.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cb3806f1-78df-4b75-93af-3492a37e0b7b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58492025-07-01T00:20:37.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cb3806f1-78df-4b75-93af-3492a37e0b7b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58502025-07-01T00:20:37.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cb3806f1-78df-4b75-93af-3492a37e0b7b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58512025-07-01T00:20:38.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c6fe475-5828-4184-b929-fe6ef9dd812c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58522025-07-01T00:20:38.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c6fe475-5828-4184-b929-fe6ef9dd812c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58532025-07-01T00:20:38.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c6fe475-5828-4184-b929-fe6ef9dd812c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58542025-07-01T00:20:39.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b65e86df-95fc-46c7-a381-cff075d10054 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58552025-07-01T00:20:39.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b65e86df-95fc-46c7-a381-cff075d10054 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58562025-07-01T00:20:39.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5420 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b65e86df-95fc-46c7-a381-cff075d10054 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58572025-07-01T00:20:40.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31476e36-acbe-4583-84cb-13d9ff5c02ee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58582025-07-01T00:20:40.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31476e36-acbe-4583-84cb-13d9ff5c02ee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58592025-07-01T00:20:40.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31476e36-acbe-4583-84cb-13d9ff5c02ee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58602025-07-01T00:20:41.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a8559ddd-61ff-40c1-89e3-59929686783e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58612025-07-01T00:20:41.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a8559ddd-61ff-40c1-89e3-59929686783e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58622025-07-01T00:20:41.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a8559ddd-61ff-40c1-89e3-59929686783e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58632025-07-01T00:20:42.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = add24b8d-8b02-4b7e-a2d0-34656a6f7d76 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58642025-07-01T00:20:42.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = add24b8d-8b02-4b7e-a2d0-34656a6f7d76 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58652025-07-01T00:20:42.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1584 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = add24b8d-8b02-4b7e-a2d0-34656a6f7d76 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58662025-07-01T00:20:43.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 431090cc-f20c-428e-8703-30dc83ad85af roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58672025-07-01T00:20:43.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 431090cc-f20c-428e-8703-30dc83ad85af resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58682025-07-01T00:20:43.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 431090cc-f20c-428e-8703-30dc83ad85af response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58692025-07-01T00:20:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
58702025-07-01T00:20:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
58712025-07-01T00:20:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58722025-07-01T00:20:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58732025-07-01T00:20:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58742025-07-01T00:20:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58752025-07-01T00:20:43.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58762025-07-01T00:20:43.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58772025-07-01T00:20:43.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58782025-07-01T00:20:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.368129ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58792025-07-01T00:20:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58802025-07-01T00:20:43.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58812025-07-01T00:20:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58822025-07-01T00:20:43.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58832025-07-01T00:20:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58842025-07-01T00:20:43.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58852025-07-01T00:20:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
58862025-07-01T00:20:43.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58872025-07-01T00:20:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58882025-07-01T00:20:43.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
58892025-07-01T00:20:43.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.637502ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
58902025-07-01T00:20:44.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c3301489-0a3d-4a0b-a5a4-3a04df8d6bbd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58912025-07-01T00:20:44.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c3301489-0a3d-4a0b-a5a4-3a04df8d6bbd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58922025-07-01T00:20:44.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c3301489-0a3d-4a0b-a5a4-3a04df8d6bbd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58932025-07-01T00:20:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = d5be26b0-765c-4686-8044-280711306379 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
58942025-07-01T00:20:45.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 02707909-d070-421b-93fb-a4bbb1130bd3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58952025-07-01T00:20:45.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 02707909-d070-421b-93fb-a4bbb1130bd3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58962025-07-01T00:20:45.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 02707909-d070-421b-93fb-a4bbb1130bd3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58972025-07-01T00:20:46.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4595b1c5-316e-4c6c-b5ac-0800c6713087 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58982025-07-01T00:20:46.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4595b1c5-316e-4c6c-b5ac-0800c6713087 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
58992025-07-01T00:20:46.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4595b1c5-316e-4c6c-b5ac-0800c6713087 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59002025-07-01T00:20:47.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53a9eda2-3796-4bff-b6db-2e9c494f30f0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59012025-07-01T00:20:47.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53a9eda2-3796-4bff-b6db-2e9c494f30f0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59022025-07-01T00:20:47.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53a9eda2-3796-4bff-b6db-2e9c494f30f0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59032025-07-01T00:20:48.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = de1c004f-ae62-45b1-b976-879e6c4a67c1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59042025-07-01T00:20:48.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = de1c004f-ae62-45b1-b976-879e6c4a67c1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59052025-07-01T00:20:48.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = de1c004f-ae62-45b1-b976-879e6c4a67c1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59062025-07-01T00:20:49.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9187f18-2b47-4b87-9493-95d224dd85d6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59072025-07-01T00:20:49.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9187f18-2b47-4b87-9493-95d224dd85d6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59082025-07-01T00:20:49.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9187f18-2b47-4b87-9493-95d224dd85d6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59092025-07-01T00:20:50.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 12f07948-3166-47c7-ad4d-bc1ea276c105 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59102025-07-01T00:20:50.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 12f07948-3166-47c7-ad4d-bc1ea276c105 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59112025-07-01T00:20:50.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 12f07948-3166-47c7-ad4d-bc1ea276c105 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59122025-07-01T00:20:51.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d1c9fd02-15b4-4620-8979-a36f9eee3cc6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59132025-07-01T00:20:51.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d1c9fd02-15b4-4620-8979-a36f9eee3cc6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59142025-07-01T00:20:51.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d1c9fd02-15b4-4620-8979-a36f9eee3cc6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59152025-07-01T00:20:52.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 52b5fc55-a15d-4b6c-b7da-9ce79a81763e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59162025-07-01T00:20:52.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 52b5fc55-a15d-4b6c-b7da-9ce79a81763e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59172025-07-01T00:20:52.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 52b5fc55-a15d-4b6c-b7da-9ce79a81763e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59182025-07-01T00:20:53.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2bf6aa02-d9d5-43ed-afc7-ceeb9b176f4e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59192025-07-01T00:20:53.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2bf6aa02-d9d5-43ed-afc7-ceeb9b176f4e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59202025-07-01T00:20:53.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2bf6aa02-d9d5-43ed-afc7-ceeb9b176f4e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
59212025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
59222025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
59232025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59242025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
59252025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59262025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59272025-07-01T00:20:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59282025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
59292025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
59302025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
59312025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59322025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59332025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59342025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
59352025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59362025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
59372025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59382025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59392025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
59402025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59412025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
59422025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59432025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
59442025-07-01T00:20:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59452025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
59462025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59472025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59482025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
59492025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
59502025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59512025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59522025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59532025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59542025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59552025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59562025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59572025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59582025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59592025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59602025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59612025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59622025-07-01T00:20:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59632025-07-01T00:20:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 729553066 } })
59642025-07-01T00:20:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 729616738 } })
59652025-07-01T00:20:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
59662025-07-01T00:20:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
59672025-07-01T00:20:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.861385ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59682025-07-01T00:20:53.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59692025-07-01T00:20:53.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59702025-07-01T00:20:53.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59712025-07-01T00:20:53.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59722025-07-01T00:20:53.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59732025-07-01T00:20:53.907ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59742025-07-01T00:20:53.907ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59752025-07-01T00:20:53.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59762025-07-01T00:20:53.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59772025-07-01T00:20:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59782025-07-01T00:20:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59792025-07-01T00:20:53.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59802025-07-01T00:20:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59812025-07-01T00:20:53.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59822025-07-01T00:20:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59832025-07-01T00:20:53.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59842025-07-01T00:20:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59852025-07-01T00:20:53.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59862025-07-01T00:20:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59872025-07-01T00:20:53.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59882025-07-01T00:20:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59892025-07-01T00:20:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59902025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59912025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59922025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59932025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59942025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59952025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59962025-07-01T00:20:53.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59972025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59982025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59992025-07-01T00:20:53.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 737504634 } })
60002025-07-01T00:20:53.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
60012025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
60022025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
60032025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60042025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60052025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
60062025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60072025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
60082025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60092025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
60102025-07-01T00:20:53.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
60112025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 20 reason = Timeout
60122025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60132025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60142025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60152025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60162025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60172025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
60182025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60192025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60202025-07-01T00:20:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 738618564 } })
60212025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60222025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60232025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60242025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60252025-07-01T00:20:53.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60262025-07-01T00:20:53.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60272025-07-01T00:20:53.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60282025-07-01T00:20:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60292025-07-01T00:20:53.916ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60302025-07-01T00:20:53.916ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 13.421837ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60312025-07-01T00:20:53.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60322025-07-01T00:20:53.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60332025-07-01T00:20:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60342025-07-01T00:20:53.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60352025-07-01T00:20:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60362025-07-01T00:20:53.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60372025-07-01T00:20:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60382025-07-01T00:20:53.921ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
60392025-07-01T00:20:53.921ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 18.147146ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
60402025-07-01T00:20:53.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
60412025-07-01T00:20:53.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60422025-07-01T00:20:53.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60432025-07-01T00:20:53.927ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 14.360543ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
60442025-07-01T00:20:53.941ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
60452025-07-01T00:20:53.941ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.954169ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
60462025-07-01T00:20:53.953ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60472025-07-01T00:20:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60482025-07-01T00:20:53.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60492025-07-01T00:20:53.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60502025-07-01T00:20:53.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60512025-07-01T00:20:53.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60522025-07-01T00:20:53.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.812588ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
60532025-07-01T00:20:53.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60542025-07-01T00:20:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60552025-07-01T00:20:53.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60562025-07-01T00:20:53.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.176233ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60572025-07-01T00:20:53.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60582025-07-01T00:20:53.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60592025-07-01T00:20:53.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60602025-07-01T00:20:53.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60612025-07-01T00:20:53.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60622025-07-01T00:20:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60632025-07-01T00:20:53.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60642025-07-01T00:20:53.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60652025-07-01T00:20:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60662025-07-01T00:20:53.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.3286ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
60672025-07-01T00:20:53.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60682025-07-01T00:20:53.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60692025-07-01T00:20:53.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60702025-07-01T00:20:53.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60712025-07-01T00:20:53.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60722025-07-01T00:20:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60732025-07-01T00:20:53.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60742025-07-01T00:20:53.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
60752025-07-01T00:20:53.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60762025-07-01T00:20:53.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60772025-07-01T00:20:53.983ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.925777ms iteration = 20 status = 0
60782025-07-01T00:20:54.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.164593ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60792025-07-01T00:20:54.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.868725ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60802025-07-01T00:20:54.008ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60812025-07-01T00:20:54.008ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60822025-07-01T00:20:54.008ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.9056ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60832025-07-01T00:20:54.016ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60842025-07-01T00:20:54.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60852025-07-01T00:20:54.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862025-07-01T00:20:54.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60872025-07-01T00:20:54.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60882025-07-01T00:20:54.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60892025-07-01T00:20:54.025ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
60902025-07-01T00:20:54.025ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60912025-07-01T00:20:54.025ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c3deb92-e86d-4614-8d28-c1e9ccecd78b", "content-length": "26", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
60922025-07-01T00:20:54.025ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60932025-07-01T00:20:54.027ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60942025-07-01T00:20:54.051ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
60952025-07-01T00:20:54.051ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfc489e2-f56b-483f-9a97-ce7de8905823", "content-length": "78", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
60962025-07-01T00:20:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
60972025-07-01T00:20:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
60982025-07-01T00:20:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
60992025-07-01T00:20:54.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
61002025-07-01T00:20:54.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
61012025-07-01T00:20:54.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
61022025-07-01T00:20:54.053ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
61032025-07-01T00:20:54.054ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
61042025-07-01T00:20:54.054ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
61052025-07-01T00:20:54.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
61062025-07-01T00:20:54.056ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
61072025-07-01T00:20:54.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
61082025-07-01T00:20:54.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
61092025-07-01T00:20:54.057ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
61102025-07-01T00:20:54.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
61112025-07-01T00:20:54.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
61122025-07-01T00:20:54.057ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
61132025-07-01T00:20:54.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
61142025-07-01T00:20:54.059ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
61152025-07-01T00:20:54.059ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
61162025-07-01T00:20:54.059ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5ad224f-4d60-4ca2-be8b-0f1001be694e", "content-length": "81", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61172025-07-01T00:20:54.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 147.459145ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61182025-07-01T00:20:54.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61192025-07-01T00:20:54.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61202025-07-01T00:20:54.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61212025-07-01T00:20:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61222025-07-01T00:20:54.086ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.435888ms iteration = 22 status = {"physical_disks_added":0}
61232025-07-01T00:20:54.091ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
61242025-07-01T00:20:54.091ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
61252025-07-01T00:20:54.091ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f234464-3eef-4be8-8b83-c36aec2dfda1", "content-length": "81", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61262025-07-01T00:20:54.091ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
61272025-07-01T00:20:54.091ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
61282025-07-01T00:20:54.092ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bc3ec9b-a53f-4940-8da4-e49a848312ef", "content-length": "81", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61292025-07-01T00:20:54.093ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 180.702074ms iteration = 20 status = {"errors":[],"sps":[]}
61302025-07-01T00:20:54.151ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 250.154854ms iteration = 20 status = {}
61312025-07-01T00:20:54.173ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
61322025-07-01T00:20:54.173ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61332025-07-01T00:20:54.174ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66436215-1a22-4dda-ae8b-f2c29419c51a", "content-length": "26", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61342025-07-01T00:20:54.174ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61352025-07-01T00:20:54.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61362025-07-01T00:20:54.192ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
61372025-07-01T00:20:54.192ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61382025-07-01T00:20:54.193ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78c10777-7c04-428f-967f-7d78a7438941", "content-length": "26", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61392025-07-01T00:20:54.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61402025-07-01T00:20:54.195ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
61412025-07-01T00:20:54.235ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61422025-07-01T00:20:54.236ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d7066a-a402-4359-8d00-d6861e94ef0e", "content-length": "691", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61432025-07-01T00:20:54.236ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
61442025-07-01T00:20:54.236ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
61452025-07-01T00:20:54.236ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
61462025-07-01T00:20:54.238ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 334.639695ms iteration = 20 status = {}
61472025-07-01T00:20:54.240ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61482025-07-01T00:20:54.240ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61492025-07-01T00:20:54.241ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "51847815-5b9c-4a96-981b-6d17b0ca7cec", "content-length": "372", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61502025-07-01T00:20:54.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61512025-07-01T00:20:54.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61522025-07-01T00:20:54.265ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61532025-07-01T00:20:54.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61542025-07-01T00:20:54.268ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 367.235858ms iteration = 20 status = null
61552025-07-01T00:20:54.297ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
61562025-07-01T00:20:54.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61572025-07-01T00:20:54.297ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35281d04-f1f8-4db9-91af-36bf672cfd97", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61582025-07-01T00:20:54.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61592025-07-01T00:20:54.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61602025-07-01T00:20:54.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61612025-07-01T00:20:54.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61622025-07-01T00:20:54.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61632025-07-01T00:20:54.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61642025-07-01T00:20:54.306ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61652025-07-01T00:20:54.306ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61662025-07-01T00:20:54.306ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4b052301-44cd-47cc-93a0-1aff5a8dc160", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61672025-07-01T00:20:54.308ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.086623ms iteration = 20 status = {}
61682025-07-01T00:20:54.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61692025-07-01T00:20:54.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61702025-07-01T00:20:54.341ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
61712025-07-01T00:20:54.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61722025-07-01T00:20:54.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61732025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
61742025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
61752025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61762025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61772025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61782025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61792025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61802025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61812025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61822025-07-01T00:20:54.354ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61832025-07-01T00:20:54.355ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
61842025-07-01T00:20:54.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61852025-07-01T00:20:54.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61862025-07-01T00:20:54.357ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
61872025-07-01T00:20:54.357ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61882025-07-01T00:20:54.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1d1f4c81-562f-401a-8e75-c9bfb5527856", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61892025-07-01T00:20:54.465ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
61902025-07-01T00:20:54.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61912025-07-01T00:20:54.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "96fa3050-e08e-4f96-9ab2-9838a9e5c018", "content-length": "682", "date": "Tue, 01 Jul 2025 00:20:54 GMT"} })
61922025-07-01T00:20:54.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61932025-07-01T00:20:54.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61942025-07-01T00:20:54.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5d5fa576-d76f-4d01-b68b-b8120604ab34 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
61952025-07-01T00:20:54.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5d5fa576-d76f-4d01-b68b-b8120604ab34 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
61962025-07-01T00:20:54.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61972025-07-01T00:20:54.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61982025-07-01T00:20:54.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5d5fa576-d76f-4d01-b68b-b8120604ab34 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
61992025-07-01T00:20:54.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62002025-07-01T00:20:54.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62012025-07-01T00:20:54.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62022025-07-01T00:20:54.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62032025-07-01T00:20:54.486ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 583.638867ms iteration = 20 status = {}
62042025-07-01T00:20:54.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = f477fde6-a3ae-48e6-aab3-132b32436ff6 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
62052025-07-01T00:20:55.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7353ac92-f89c-4802-bc68-6c53bd94a260 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62062025-07-01T00:20:55.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7353ac92-f89c-4802-bc68-6c53bd94a260 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62072025-07-01T00:20:55.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7353ac92-f89c-4802-bc68-6c53bd94a260 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62082025-07-01T00:20:56.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e2d5d4da-d93a-4903-af22-5613da273f2a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62092025-07-01T00:20:56.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e2d5d4da-d93a-4903-af22-5613da273f2a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62102025-07-01T00:20:56.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e2d5d4da-d93a-4903-af22-5613da273f2a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62112025-07-01T00:20:57.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ccfbd890-4316-4be8-a8fe-0d13039d886f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62122025-07-01T00:20:57.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ccfbd890-4316-4be8-a8fe-0d13039d886f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62132025-07-01T00:20:57.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ccfbd890-4316-4be8-a8fe-0d13039d886f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62142025-07-01T00:20:58.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b824558d-b8b6-4865-9942-8c50972021ef roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62152025-07-01T00:20:58.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b824558d-b8b6-4865-9942-8c50972021ef resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62162025-07-01T00:20:58.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b824558d-b8b6-4865-9942-8c50972021ef response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62172025-07-01T00:20:59.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 981b20ac-a6cc-4f3e-9178-d655301a3211 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62182025-07-01T00:20:59.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 981b20ac-a6cc-4f3e-9178-d655301a3211 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62192025-07-01T00:20:59.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 981b20ac-a6cc-4f3e-9178-d655301a3211 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62202025-07-01T00:21:00.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4904ea55-31a1-4742-a71a-0e03e2494383 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62212025-07-01T00:21:00.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4904ea55-31a1-4742-a71a-0e03e2494383 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62222025-07-01T00:21:00.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4904ea55-31a1-4742-a71a-0e03e2494383 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62232025-07-01T00:21:01.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1bebf8b7-3780-4f92-897d-292d6058cc63 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62242025-07-01T00:21:01.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1bebf8b7-3780-4f92-897d-292d6058cc63 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62252025-07-01T00:21:01.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1bebf8b7-3780-4f92-897d-292d6058cc63 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62262025-07-01T00:21:02.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a8dc0776-f25a-4ab3-982f-55b50e8e804c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62272025-07-01T00:21:02.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a8dc0776-f25a-4ab3-982f-55b50e8e804c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62282025-07-01T00:21:02.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a8dc0776-f25a-4ab3-982f-55b50e8e804c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62292025-07-01T00:21:03.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 82596b9b-f0f0-4639-99f4-be3575682b19 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62302025-07-01T00:21:03.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 82596b9b-f0f0-4639-99f4-be3575682b19 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62312025-07-01T00:21:03.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 82596b9b-f0f0-4639-99f4-be3575682b19 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62322025-07-01T00:21:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
62332025-07-01T00:21:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
62342025-07-01T00:21:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62352025-07-01T00:21:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62362025-07-01T00:21:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62372025-07-01T00:21:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62382025-07-01T00:21:03.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62392025-07-01T00:21:03.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62402025-07-01T00:21:03.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62412025-07-01T00:21:03.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62422025-07-01T00:21:03.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62432025-07-01T00:21:03.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62442025-07-01T00:21:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62452025-07-01T00:21:03.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62462025-07-01T00:21:03.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472025-07-01T00:21:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
62482025-07-01T00:21:03.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62492025-07-01T00:21:03.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62502025-07-01T00:21:03.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
62512025-07-01T00:21:03.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.080322ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
62522025-07-01T00:21:03.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.804139ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62532025-07-01T00:21:04.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 90a2acfc-2f70-4bf0-91db-0d180c510078 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62542025-07-01T00:21:04.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 90a2acfc-2f70-4bf0-91db-0d180c510078 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62552025-07-01T00:21:04.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 90a2acfc-2f70-4bf0-91db-0d180c510078 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62562025-07-01T00:21:04.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 474b97ce-11ea-44f1-9b21-a7b7cdc88a54 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
62572025-07-01T00:21:04.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 474b97ce-11ea-44f1-9b21-a7b7cdc88a54 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
62582025-07-01T00:21:04.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2859 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 474b97ce-11ea-44f1-9b21-a7b7cdc88a54 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
62592025-07-01T00:21:04.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = b9cec25f-1312-4e0c-9ab2-3d26737d05bd roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
62602025-07-01T00:21:04.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = b9cec25f-1312-4e0c-9ab2-3d26737d05bd resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
62612025-07-01T00:21:04.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = b9cec25f-1312-4e0c-9ab2-3d26737d05bd response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
62622025-07-01T00:21:04.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 737d772e-f1e8-4776-bdd0-0b9edaebb9c6 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
62632025-07-01T00:21:05.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc2907cd-78f0-47f4-8bdb-a471d5d7adea roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62642025-07-01T00:21:05.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc2907cd-78f0-47f4-8bdb-a471d5d7adea resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62652025-07-01T00:21:05.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dc2907cd-78f0-47f4-8bdb-a471d5d7adea response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62662025-07-01T00:21:06.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 095fe382-3398-4468-8ed8-1c6e596ade36 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62672025-07-01T00:21:06.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 095fe382-3398-4468-8ed8-1c6e596ade36 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62682025-07-01T00:21:06.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 095fe382-3398-4468-8ed8-1c6e596ade36 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62692025-07-01T00:21:07.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 40db2119-f6b2-46b8-bef8-f7c265645701 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62702025-07-01T00:21:07.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 40db2119-f6b2-46b8-bef8-f7c265645701 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62712025-07-01T00:21:07.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 40db2119-f6b2-46b8-bef8-f7c265645701 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62722025-07-01T00:21:08.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4aea9863-3a72-40f1-9c24-16f9200db545 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62732025-07-01T00:21:08.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4aea9863-3a72-40f1-9c24-16f9200db545 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62742025-07-01T00:21:08.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4aea9863-3a72-40f1-9c24-16f9200db545 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62752025-07-01T00:21:09.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 58e73821-64a1-47ce-bd9d-19cad65b81f4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62762025-07-01T00:21:09.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 58e73821-64a1-47ce-bd9d-19cad65b81f4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62772025-07-01T00:21:09.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 58e73821-64a1-47ce-bd9d-19cad65b81f4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62782025-07-01T00:21:10.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 922be9f6-6d1d-4695-81b7-eb6d1fcd7102 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62792025-07-01T00:21:10.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 922be9f6-6d1d-4695-81b7-eb6d1fcd7102 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62802025-07-01T00:21:10.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 922be9f6-6d1d-4695-81b7-eb6d1fcd7102 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62812025-07-01T00:21:11.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f4e77322-f765-4541-9485-63383e7b7df9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62822025-07-01T00:21:11.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f4e77322-f765-4541-9485-63383e7b7df9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62832025-07-01T00:21:11.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f4e77322-f765-4541-9485-63383e7b7df9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62842025-07-01T00:21:12.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 130d8931-887d-432f-90d3-0d9fd15d5736 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62852025-07-01T00:21:12.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 130d8931-887d-432f-90d3-0d9fd15d5736 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62862025-07-01T00:21:12.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1686 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 130d8931-887d-432f-90d3-0d9fd15d5736 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62872025-07-01T00:21:13.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 892c4db3-73fa-47ed-a5b1-1cbd8ec986d3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62882025-07-01T00:21:13.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 892c4db3-73fa-47ed-a5b1-1cbd8ec986d3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62892025-07-01T00:21:13.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 892c4db3-73fa-47ed-a5b1-1cbd8ec986d3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
62902025-07-01T00:21:13.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
62912025-07-01T00:21:13.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
62922025-07-01T00:21:13.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62932025-07-01T00:21:13.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62942025-07-01T00:21:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62952025-07-01T00:21:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62962025-07-01T00:21:13.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62972025-07-01T00:21:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62982025-07-01T00:21:13.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62992025-07-01T00:21:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63002025-07-01T00:21:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63012025-07-01T00:21:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63022025-07-01T00:21:13.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63032025-07-01T00:21:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
63042025-07-01T00:21:13.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63052025-07-01T00:21:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63062025-07-01T00:21:13.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
63072025-07-01T00:21:13.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.347134ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
63082025-07-01T00:21:13.937ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63092025-07-01T00:21:13.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63102025-07-01T00:21:13.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.227572ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63112025-07-01T00:21:14.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d536ebba-f400-4161-bac2-3e604a17d6cb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63122025-07-01T00:21:14.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d536ebba-f400-4161-bac2-3e604a17d6cb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63132025-07-01T00:21:14.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d536ebba-f400-4161-bac2-3e604a17d6cb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63142025-07-01T00:21:14.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 5d27c988-c53e-4842-9583-4e3153058f33 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
63152025-07-01T00:21:15.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cbffac22-131f-490d-b97f-5b9c1a28fb90 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63162025-07-01T00:21:15.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cbffac22-131f-490d-b97f-5b9c1a28fb90 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63172025-07-01T00:21:15.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cbffac22-131f-490d-b97f-5b9c1a28fb90 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63182025-07-01T00:21:16.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 935472e4-09bf-4a31-8b0d-800e951a95fb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63192025-07-01T00:21:16.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 935472e4-09bf-4a31-8b0d-800e951a95fb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63202025-07-01T00:21:16.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 935472e4-09bf-4a31-8b0d-800e951a95fb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63212025-07-01T00:21:17.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31e21825-23ea-4085-9432-6519229bf23f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63222025-07-01T00:21:17.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31e21825-23ea-4085-9432-6519229bf23f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63232025-07-01T00:21:17.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 31e21825-23ea-4085-9432-6519229bf23f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63242025-07-01T00:21:18.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d156619-7ad7-4636-a7a2-8eab362ccdbb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63252025-07-01T00:21:18.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d156619-7ad7-4636-a7a2-8eab362ccdbb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63262025-07-01T00:21:18.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2586 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d156619-7ad7-4636-a7a2-8eab362ccdbb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63272025-07-01T00:21:19.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 237e7bd7-0738-43f1-8a93-e53c5fc157b7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63282025-07-01T00:21:19.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 237e7bd7-0738-43f1-8a93-e53c5fc157b7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63292025-07-01T00:21:19.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 237e7bd7-0738-43f1-8a93-e53c5fc157b7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63302025-07-01T00:21:20.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4a4df4b1-871d-4f84-8462-9dc9ef52454a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63312025-07-01T00:21:20.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4a4df4b1-871d-4f84-8462-9dc9ef52454a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63322025-07-01T00:21:20.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4a4df4b1-871d-4f84-8462-9dc9ef52454a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63332025-07-01T00:21:21.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9d42cf7b-cedb-4c20-9fac-f9aa57be84ca roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63342025-07-01T00:21:21.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9d42cf7b-cedb-4c20-9fac-f9aa57be84ca resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63352025-07-01T00:21:21.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9d42cf7b-cedb-4c20-9fac-f9aa57be84ca response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63362025-07-01T00:21:22.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 631e9521-91c9-4030-971b-529263fe6ed3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63372025-07-01T00:21:22.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 631e9521-91c9-4030-971b-529263fe6ed3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63382025-07-01T00:21:22.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 631e9521-91c9-4030-971b-529263fe6ed3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
63392025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
63402025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
63412025-07-01T00:21:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
63422025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
63432025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.31\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
63442025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63452025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
63462025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63472025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
63482025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
63492025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
63502025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63512025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
63522025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
63532025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
63542025-07-01T00:21:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:11:23.901631650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
63552025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
63562025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
63572025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
63582025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63592025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
63602025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
63612025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63622025-07-01T00:21:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63632025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63642025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63652025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63662025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
63672025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63682025-07-01T00:21:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 727566182 } })
63692025-07-01T00:21:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 727573822 } })
63702025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
63712025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.158982ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
63722025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
63732025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.211804ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
63742025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
63752025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
63762025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63772025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 14 reason = Timeout
63782025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63792025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
63802025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 5.77\u{b5}s iteration = 14 status = "Disabled"
63812025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
63822025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
63832025-07-01T00:21:23.902ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
63842025-07-01T00:21:23.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63852025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63862025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
63872025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
63882025-07-01T00:21:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
63892025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
63902025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63912025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
63922025-07-01T00:21:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63932025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
63942025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63952025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63962025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
63972025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63982025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
63992025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
64002025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
64012025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64022025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64032025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
64042025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64052025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
64062025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64072025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
64082025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64092025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
64102025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64112025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64122025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
64132025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
64142025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64152025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64162025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64172025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64182025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64192025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64202025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64212025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
64222025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64232025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64242025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
64252025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64262025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64272025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64282025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64292025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64302025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64312025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64322025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64332025-07-01T00:21:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64342025-07-01T00:21:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.993932ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64352025-07-01T00:21:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64362025-07-01T00:21:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64372025-07-01T00:21:23.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 731033127 } })
64382025-07-01T00:21:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
64392025-07-01T00:21:23.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 731457828 } })
64402025-07-01T00:21:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
64412025-07-01T00:21:23.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:11:23.901631650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
64422025-07-01T00:21:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.843943ms iteration = 11 status = {"expiration":"2025-07-01T00:11:23.901631650Z","pruned":[]}
64432025-07-01T00:21:23.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64442025-07-01T00:21:23.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64452025-07-01T00:21:23.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64462025-07-01T00:21:23.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64472025-07-01T00:21:23.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64482025-07-01T00:21:23.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64492025-07-01T00:21:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64502025-07-01T00:21:23.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64512025-07-01T00:21:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64522025-07-01T00:21:23.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64532025-07-01T00:21:23.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64542025-07-01T00:21:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
64552025-07-01T00:21:23.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64562025-07-01T00:21:23.911ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64572025-07-01T00:21:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64582025-07-01T00:21:23.912ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
64592025-07-01T00:21:23.912ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
64602025-07-01T00:21:23.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
64612025-07-01T00:21:23.912ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
64622025-07-01T00:21:23.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
64632025-07-01T00:21:23.912ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
64642025-07-01T00:21:23.912ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
64652025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
64662025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
64672025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
64682025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64692025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
64702025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
64712025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
64722025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64732025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
64742025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64752025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
64762025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64772025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 21 reason = Timeout
64782025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
64792025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64802025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
64812025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64822025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
64832025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
64842025-07-01T00:21:23.913ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
64852025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64862025-07-01T00:21:23.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 738818880 } })
64872025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64882025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64892025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64902025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64912025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
64922025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
64932025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64942025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
64952025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64962025-07-01T00:21:23.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64972025-07-01T00:21:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64982025-07-01T00:21:23.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64992025-07-01T00:21:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
65002025-07-01T00:21:23.915ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65012025-07-01T00:21:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65022025-07-01T00:21:23.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65032025-07-01T00:21:23.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65042025-07-01T00:21:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65052025-07-01T00:21:23.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65062025-07-01T00:21:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65072025-07-01T00:21:23.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65082025-07-01T00:21:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65092025-07-01T00:21:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65102025-07-01T00:21:23.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65112025-07-01T00:21:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65122025-07-01T00:21:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65132025-07-01T00:21:23.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65142025-07-01T00:21:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65152025-07-01T00:21:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65162025-07-01T00:21:23.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65172025-07-01T00:21:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65182025-07-01T00:21:23.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65192025-07-01T00:21:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65202025-07-01T00:21:23.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65212025-07-01T00:21:23.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65222025-07-01T00:21:23.924ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
65232025-07-01T00:21:23.924ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 11.909286ms iteration = 11 status = {"by_rx":{},"error":null}
65242025-07-01T00:21:23.927ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65252025-07-01T00:21:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65262025-07-01T00:21:23.929ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.422809ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
65272025-07-01T00:21:23.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 61b0d9bb-120c-43e4-b16d-58eaa5744053 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
65282025-07-01T00:21:23.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 61b0d9bb-120c-43e4-b16d-58eaa5744053 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
65292025-07-01T00:21:23.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65302025-07-01T00:21:23.972ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65312025-07-01T00:21:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65322025-07-01T00:21:23.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65332025-07-01T00:21:23.974ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65342025-07-01T00:21:23.974ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65352025-07-01T00:21:23.974ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.008123ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65362025-07-01T00:21:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65372025-07-01T00:21:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65382025-07-01T00:21:23.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65392025-07-01T00:21:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65402025-07-01T00:21:23.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65412025-07-01T00:21:23.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65422025-07-01T00:21:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65432025-07-01T00:21:23.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65442025-07-01T00:21:23.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65452025-07-01T00:21:23.977ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65462025-07-01T00:21:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65472025-07-01T00:21:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65482025-07-01T00:21:23.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65492025-07-01T00:21:23.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65502025-07-01T00:21:23.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65512025-07-01T00:21:23.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65522025-07-01T00:21:23.980ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(920e400e-e0b8-4ebd-b7f4-2e9010231362, 0), (ea8f8c6b-0a31-4f11-8662-59545b100f75, 0), (1cc8d96f-eaa9-4d6a-85c0-6989122fe188, 0), (9524286b-16b2-491e-9a55-debb55bd74d6, 0)] collection_id = 920e400e-e0b8-4ebd-b7f4-2e9010231362
65532025-07-01T00:21:23.980ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
65542025-07-01T00:21:23.980ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65552025-07-01T00:21:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
65562025-07-01T00:21:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65572025-07-01T00:21:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65582025-07-01T00:21:23.981ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 806415469 } })
65592025-07-01T00:21:23.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65602025-07-01T00:21:23.981ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
65612025-07-01T00:21:23.981ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65622025-07-01T00:21:23.981ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65632025-07-01T00:21:23.981ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65642025-07-01T00:21:23.981ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65652025-07-01T00:21:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65662025-07-01T00:21:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65672025-07-01T00:21:23.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65682025-07-01T00:21:23.982ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692025-07-01T00:21:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65702025-07-01T00:21:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65712025-07-01T00:21:23.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.205011ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
65722025-07-01T00:21:23.983ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732025-07-01T00:21:23.983ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.802078ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
65742025-07-01T00:21:23.984ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65752025-07-01T00:21:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65762025-07-01T00:21:23.984ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
65772025-07-01T00:21:23.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 44316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 61b0d9bb-120c-43e4-b16d-58eaa5744053 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
65782025-07-01T00:21:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
65792025-07-01T00:21:23.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.210896ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
65802025-07-01T00:21:23.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.573479ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65812025-07-01T00:21:23.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65822025-07-01T00:21:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65832025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
65842025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65852025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65862025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65872025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65882025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65892025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65902025-07-01T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65912025-07-01T00:21:23.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65922025-07-01T00:21:23.988ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65932025-07-01T00:21:23.990ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
65942025-07-01T00:21:23.990ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
65952025-07-01T00:21:23.990ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.432952ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
65962025-07-01T00:21:23.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65972025-07-01T00:21:23.990ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65982025-07-01T00:21:23.990ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65992025-07-01T00:21:23.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66002025-07-01T00:21:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66012025-07-01T00:21:23.991ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 78.376854ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
66022025-07-01T00:21:23.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
66032025-07-01T00:21:23.991ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
66042025-07-01T00:21:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
66052025-07-01T00:21:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
66062025-07-01T00:21:23.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66072025-07-01T00:21:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66082025-07-01T00:21:23.996ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
66092025-07-01T00:21:23.996ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 83.196146ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
66102025-07-01T00:21:24.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.070789ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66112025-07-01T00:21:24.029ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66122025-07-01T00:21:24.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66132025-07-01T00:21:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66142025-07-01T00:21:24.031ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
66152025-07-01T00:21:24.031ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.855016ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66162025-07-01T00:21:24.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.843039ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66172025-07-01T00:21:24.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
66182025-07-01T00:21:24.033ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
66192025-07-01T00:21:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.49767ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66202025-07-01T00:21:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
66212025-07-01T00:21:24.034ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66222025-07-01T00:21:24.034ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.046386ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66232025-07-01T00:21:24.035ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
66242025-07-01T00:21:24.035ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
66252025-07-01T00:21:24.035ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
66262025-07-01T00:21:24.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66272025-07-01T00:21:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66282025-07-01T00:21:24.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66292025-07-01T00:21:24.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66302025-07-01T00:21:24.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66312025-07-01T00:21:24.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66322025-07-01T00:21:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66332025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66342025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66352025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66362025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66372025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66382025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66392025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66402025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66412025-07-01T00:21:24.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66422025-07-01T00:21:24.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66432025-07-01T00:21:24.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66442025-07-01T00:21:24.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66452025-07-01T00:21:24.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66462025-07-01T00:21:24.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66472025-07-01T00:21:24.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66482025-07-01T00:21:24.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66492025-07-01T00:21:24.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66502025-07-01T00:21:24.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66512025-07-01T00:21:24.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66522025-07-01T00:21:24.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66532025-07-01T00:21:24.045ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66542025-07-01T00:21:24.045ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
66552025-07-01T00:21:24.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66562025-07-01T00:21:24.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66572025-07-01T00:21:24.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66582025-07-01T00:21:24.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66592025-07-01T00:21:24.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66602025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
66612025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66622025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
66632025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66642025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66652025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
66662025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 145.633824ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
66672025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66682025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66692025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66702025-07-01T00:21:24.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66712025-07-01T00:21:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
66722025-07-01T00:21:24.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66732025-07-01T00:21:24.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66742025-07-01T00:21:24.050ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.251359ms iteration = 21 status = 0
66752025-07-01T00:21:24.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66762025-07-01T00:21:24.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66772025-07-01T00:21:24.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66782025-07-01T00:21:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66792025-07-01T00:21:24.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66802025-07-01T00:21:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66812025-07-01T00:21:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66822025-07-01T00:21:24.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66832025-07-01T00:21:24.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66842025-07-01T00:21:24.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66852025-07-01T00:21:24.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
66862025-07-01T00:21:24.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66872025-07-01T00:21:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66882025-07-01T00:21:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66892025-07-01T00:21:24.054ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
66902025-07-01T00:21:24.054ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66912025-07-01T00:21:24.054ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
66922025-07-01T00:21:24.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.690798ms iteration = 11 status = {"generation":2}
66932025-07-01T00:21:24.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66942025-07-01T00:21:24.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
66952025-07-01T00:21:24.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
66962025-07-01T00:21:24.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
66972025-07-01T00:21:24.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66982025-07-01T00:21:24.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
66992025-07-01T00:21:24.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67002025-07-01T00:21:24.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67012025-07-01T00:21:24.059ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67022025-07-01T00:21:24.059ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67032025-07-01T00:21:24.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.572794ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67042025-07-01T00:21:24.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67052025-07-01T00:21:24.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67062025-07-01T00:21:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67072025-07-01T00:21:24.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67082025-07-01T00:21:24.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67092025-07-01T00:21:24.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67102025-07-01T00:21:24.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
67112025-07-01T00:21:24.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
67122025-07-01T00:21:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
67132025-07-01T00:21:24.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67142025-07-01T00:21:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67152025-07-01T00:21:24.065ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
67162025-07-01T00:21:24.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67172025-07-01T00:21:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 163.139113ms iteration = 5 status = {"blueprint_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","inventory_collection_id":"9524286b-16b2-491e-9a55-debb55bd74d6","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
67182025-07-01T00:21:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67192025-07-01T00:21:24.066ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 920e400e-e0b8-4ebd-b7f4-2e9010231362 file = nexus/db-queries/src/db/datastore/inventory.rs:1937 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmupdate_override_non_boot = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agents = 0 nsps = 2 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
67202025-07-01T00:21:24.066ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67212025-07-01T00:21:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67222025-07-01T00:21:24.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67232025-07-01T00:21:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67242025-07-01T00:21:24.069ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(ea8f8c6b-0a31-4f11-8662-59545b100f75, 0), (1cc8d96f-eaa9-4d6a-85c0-6989122fe188, 0), (9524286b-16b2-491e-9a55-debb55bd74d6, 0)]
67252025-07-01T00:21:24.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67262025-07-01T00:21:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67272025-07-01T00:21:24.070ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 895427195 } })
67282025-07-01T00:21:24.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67292025-07-01T00:21:24.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67302025-07-01T00:21:24.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67312025-07-01T00:21:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
67322025-07-01T00:21:24.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67332025-07-01T00:21:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67342025-07-01T00:21:24.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67352025-07-01T00:21:24.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67362025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67372025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
67382025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67392025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd1513f8-c50b-460e-8224-361c88ca179f", "content-length": "78", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
67402025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
67412025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
67422025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
67432025-07-01T00:21:24.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
67442025-07-01T00:21:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
67452025-07-01T00:21:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
67462025-07-01T00:21:24.085ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
67472025-07-01T00:21:24.085ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
67482025-07-01T00:21:24.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67492025-07-01T00:21:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67502025-07-01T00:21:24.087ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
67512025-07-01T00:21:24.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67522025-07-01T00:21:24.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67532025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
67542025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
67552025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
67562025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
67572025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67582025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
67592025-07-01T00:21:24.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
67602025-07-01T00:21:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67612025-07-01T00:21:24.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
67622025-07-01T00:21:24.090ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
67632025-07-01T00:21:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
67642025-07-01T00:21:24.091ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
67652025-07-01T00:21:24.091ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
67662025-07-01T00:21:24.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67672025-07-01T00:21:24.091ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f5860aa-bd24-49e8-a405-2413f3b5a396", "content-length": "81", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
67682025-07-01T00:21:24.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67692025-07-01T00:21:24.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67702025-07-01T00:21:24.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67712025-07-01T00:21:24.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67722025-07-01T00:21:24.102ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67732025-07-01T00:21:24.102ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67742025-07-01T00:21:24.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67752025-07-01T00:21:24.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67762025-07-01T00:21:24.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
67772025-07-01T00:21:24.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782025-07-01T00:21:24.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67792025-07-01T00:21:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67802025-07-01T00:21:24.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67812025-07-01T00:21:24.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67822025-07-01T00:21:24.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67832025-07-01T00:21:24.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67842025-07-01T00:21:24.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67852025-07-01T00:21:24.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67862025-07-01T00:21:24.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67872025-07-01T00:21:24.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
67882025-07-01T00:21:24.108ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67892025-07-01T00:21:24.109ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50e2e299-75f5-4cf7-8da2-1492456f565e", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
67902025-07-01T00:21:24.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67912025-07-01T00:21:24.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922025-07-01T00:21:24.110ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
67932025-07-01T00:21:24.110ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67942025-07-01T00:21:24.110ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
67952025-07-01T00:21:24.110ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 208.924127ms iteration = 11 status = {"generation":1}
67962025-07-01T00:21:24.110ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67972025-07-01T00:21:24.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
67982025-07-01T00:21:24.115ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67992025-07-01T00:21:24.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68002025-07-01T00:21:24.116ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
68012025-07-01T00:21:24.116ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 215.049034ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68022025-07-01T00:21:24.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68032025-07-01T00:21:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68042025-07-01T00:21:24.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68052025-07-01T00:21:24.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68062025-07-01T00:21:24.124ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.954496ms iteration = 23 status = {"physical_disks_added":0}
68072025-07-01T00:21:24.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68082025-07-01T00:21:24.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68092025-07-01T00:21:24.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68102025-07-01T00:21:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68112025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68122025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
68132025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
68142025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68152025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68162025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b219edf-d1e0-4f26-a5da-3c69ebdd882f", "content-length": "81", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
68172025-07-01T00:21:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68182025-07-01T00:21:24.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68192025-07-01T00:21:24.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68202025-07-01T00:21:24.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68212025-07-01T00:21:24.135ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
68222025-07-01T00:21:24.135ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68232025-07-01T00:21:24.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68242025-07-01T00:21:24.135ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8d290fc-fffb-4d4f-b192-0834ce71a2bf", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
68252025-07-01T00:21:24.135ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68262025-07-01T00:21:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68272025-07-01T00:21:24.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68282025-07-01T00:21:24.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68292025-07-01T00:21:24.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68302025-07-01T00:21:24.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312025-07-01T00:21:24.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68322025-07-01T00:21:24.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68332025-07-01T00:21:24.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68342025-07-01T00:21:24.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68352025-07-01T00:21:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68362025-07-01T00:21:24.145ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
68372025-07-01T00:21:24.145ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
68382025-07-01T00:21:24.145ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d9ec426-2501-4b19-b71e-5a877a88d37c", "content-length": "81", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
68392025-07-01T00:21:24.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
68402025-07-01T00:21:24.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68412025-07-01T00:21:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68422025-07-01T00:21:24.148ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 235.274928ms iteration = 21 status = {"errors":[],"sps":[]}
68432025-07-01T00:21:24.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68442025-07-01T00:21:24.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68452025-07-01T00:21:24.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68462025-07-01T00:21:24.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68472025-07-01T00:21:24.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68482025-07-01T00:21:24.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
68492025-07-01T00:21:24.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68502025-07-01T00:21:24.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68512025-07-01T00:21:24.194ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 7e1b4ef2-2e3d-423a-9b28-b3d9bb193acd, kind: Service { id: e0ddf814-75e5-4f70-adea-4a3baebe5d2e }, name: Name("external-dns-e0ddf814-75e5-4f70-adea-4a3baebe5d2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3199264-c95c-4efe-8cbb-2197130f77ca, kind: Service { id: 41eebb95-a44a-4913-b805-5e5fb485fcae }, name: Name("external-dns-41eebb95-a44a-4913-b805-5e5fb485fcae"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4f274681-7557-4e69-bb36-c34e43fd83b4, kind: Service { id: 021f35b4-60a5-480d-bcf4-37411a034e6a }, name: Name("nexus-021f35b4-60a5-480d-bcf4-37411a034e6a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 854adf72-e8e4-4b08-88d2-091cbe26a690, kind: Service { id: 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6 }, name: Name("nexus-8da13144-b1e3-4f04-bf20-cd1fcf6b40c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 31])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d06d12c1-c26d-48d7-b479-dfb11b5f2c03, kind: Service { id: e258d80d-279a-4e4d-8211-359a29b37a8c }, name: Name("nexus-e258d80d-279a-4e4d-8211-359a29b37a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
68522025-07-01T00:21:24.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68532025-07-01T00:21:24.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68542025-07-01T00:21:24.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68552025-07-01T00:21:24.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
68562025-07-01T00:21:24.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68572025-07-01T00:21:24.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68582025-07-01T00:21:24.202ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
68592025-07-01T00:21:24.202ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7e1b4ef2-2e3d-423a-9b28-b3d9bb193acd, kind: Service { id: e0ddf814-75e5-4f70-adea-4a3baebe5d2e }, name: Name("external-dns-e0ddf814-75e5-4f70-adea-4a3baebe5d2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3199264-c95c-4efe-8cbb-2197130f77ca, kind: Service { id: 41eebb95-a44a-4913-b805-5e5fb485fcae }, name: Name("external-dns-41eebb95-a44a-4913-b805-5e5fb485fcae"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 164])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f274681-7557-4e69-bb36-c34e43fd83b4, kind: Service { id: 021f35b4-60a5-480d-bcf4-37411a034e6a }, name: Name("nexus-021f35b4-60a5-480d-bcf4-37411a034e6a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 854adf72-e8e4-4b08-88d2-091cbe26a690, kind: Service { id: 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6 }, name: Name("nexus-8da13144-b1e3-4f04-bf20-cd1fcf6b40c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 31])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d06d12c1-c26d-48d7-b479-dfb11b5f2c03, kind: Service { id: e258d80d-279a-4e4d-8211-359a29b37a8c }, name: Name("nexus-e258d80d-279a-4e4d-8211-359a29b37a8c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
68602025-07-01T00:21:24.202ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
68612025-07-01T00:21:24.271ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
68622025-07-01T00:21:24.271ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 368.202814ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68632025-07-01T00:21:24.281ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
68642025-07-01T00:21:24.281ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68652025-07-01T00:21:24.281ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0120a138-c872-4278-ad01-d3cb8cfcb544", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
68662025-07-01T00:21:24.281ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68672025-07-01T00:21:24.283ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
68682025-07-01T00:21:24.369ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 887ec56b-486c-42d4-930b-b7b47cbacc61, time_created: 2025-07-01T00:11:35.920338Z, time_modified: 2025-07-01T00:11:35.920338Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
68692025-07-01T00:21:24.369ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
68702025-07-01T00:21:24.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68712025-07-01T00:21:24.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "55d16eda-7001-46ef-8e69-56f0c86b5954", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68722025-07-01T00:21:24.375ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68732025-07-01T00:21:24.378ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b5d87c12-44c4-4765-a4f3-a91b4d931a51", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68742025-07-01T00:21:24.378ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68752025-07-01T00:21:24.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68762025-07-01T00:21:24.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 479.374245ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
68772025-07-01T00:21:24.414ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 513.268552ms iteration = 21 status = {}
68782025-07-01T00:21:24.472ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68792025-07-01T00:21:24.473ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a4af46b-cae5-4bb8-a986-774997a127c8", "content-length": "691", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
68802025-07-01T00:21:24.473ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68812025-07-01T00:21:24.473ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68822025-07-01T00:21:24.473ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68832025-07-01T00:21:24.475ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 571.931827ms iteration = 21 status = {}
68842025-07-01T00:21:24.476ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68852025-07-01T00:21:24.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68862025-07-01T00:21:24.479ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68872025-07-01T00:21:24.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
68882025-07-01T00:21:24.481ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68892025-07-01T00:21:24.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68902025-07-01T00:21:24.483ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68912025-07-01T00:21:24.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68922025-07-01T00:21:24.485ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68932025-07-01T00:21:24.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
68942025-07-01T00:21:24.488ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
68952025-07-01T00:21:24.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
68962025-07-01T00:21:24.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68972025-07-01T00:21:24.489ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
68982025-07-01T00:21:24.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "e045ea45-055d-4816-a5d0-868812f4d678", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
68992025-07-01T00:21:24.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
69002025-07-01T00:21:24.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c36c1a9-c8bc-4a44-9c8d-aaecaaf1efbe", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69012025-07-01T00:21:24.490ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:669 sled = http://[fd00:1122:3344:101::1]:12345
69022025-07-01T00:21:24.492ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 579.182825ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"887ec56b-486c-42d4-930b-b7b47cbacc61","time":"2025-07-01T00:16:24.368804678Z"},{"operation":"list","target_sled":"887ec56b-486c-42d4-930b-b7b47cbacc61","time":"2025-07-01T00:16:24.369090216Z"},{"generation":1,"operation":"put_config","target_sled":"887ec56b-486c-42d4-930b-b7b47cbacc61","time":"2025-07-01T00:21:24.490556462Z"},{"operation":"list","target_sled":"887ec56b-486c-42d4-930b-b7b47cbacc61","time":"2025-07-01T00:21:24.490828940Z"}]}
69032025-07-01T00:21:24.499ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69042025-07-01T00:21:24.499ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69052025-07-01T00:21:24.499ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c174d455-a3ef-48a6-80fe-2ac8ba9e86bc", "content-length": "372", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69062025-07-01T00:21:24.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69072025-07-01T00:21:24.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69082025-07-01T00:21:24.512ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69092025-07-01T00:21:24.512ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69102025-07-01T00:21:24.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6b06e3ff-0901-4bb3-8cca-6e0b66566769", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69112025-07-01T00:21:24.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69122025-07-01T00:21:24.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69132025-07-01T00:21:24.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69142025-07-01T00:21:24.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69152025-07-01T00:21:24.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69162025-07-01T00:21:24.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69172025-07-01T00:21:24.523ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69182025-07-01T00:21:24.523ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69192025-07-01T00:21:24.523ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dac1d2b1-9e7f-4561-af2a-8268a64a6663", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69202025-07-01T00:21:24.525ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 622.605063ms iteration = 21 status = {}
69212025-07-01T00:21:24.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69222025-07-01T00:21:24.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69232025-07-01T00:21:24.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69242025-07-01T00:21:24.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69252025-07-01T00:21:24.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69262025-07-01T00:21:24.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
69272025-07-01T00:21:24.567ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
69282025-07-01T00:21:24.567ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "54b65ce3-3e28-4b17-bb46-406b5f62e219", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69292025-07-01T00:21:24.570ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
69302025-07-01T00:21:24.570ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 667.0971ms
69312025-07-01T00:21:24.570ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 667.10376ms iteration = 3 status = {}
69322025-07-01T00:21:24.578ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
69332025-07-01T00:21:24.578ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
69342025-07-01T00:21:24.578ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
69352025-07-01T00:21:24.579ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca5aff4-ed9e-4db7-a024-61470bb55d9b", "content-length": "476", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69362025-07-01T00:21:24.579ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
69372025-07-01T00:21:24.579ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a73b074a-4cbd-4193-b057-2acdabb2080e", "content-length": "734", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69382025-07-01T00:21:24.579ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
69392025-07-01T00:21:24.580ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "65c965c8-f359-40a4-8cea-bd604e309d8e", "content-length": "111", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69402025-07-01T00:21:24.580ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
69412025-07-01T00:21:24.580ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8077504-1ccc-4c0a-9c22-1696f7af9f24", "content-length": "111", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69422025-07-01T00:21:24.580ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
69432025-07-01T00:21:24.580ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2f06f46-eaa0-4a12-8504-a1843a114a06", "content-length": "170", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69442025-07-01T00:21:24.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
69452025-07-01T00:21:24.581ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2393b8f1-4bce-4c4e-939d-efcee503c040", "content-length": "170", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69462025-07-01T00:21:24.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
69472025-07-01T00:21:24.581ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36866fd6-1dd3-4d11-aa15-992ab33005d4", "content-length": "179", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69482025-07-01T00:21:24.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
69492025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "56dbb66e-e2c8-4eb8-877c-5e3eb02e60c6", "content-length": "179", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69502025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
69512025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "962929c0-4b3b-438c-9f1f-a6a3e08dc8a7", "content-length": "702", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69522025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
69532025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3490277e-a5a9-4db3-b2b5-899f1f647881", "content-length": "727", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69542025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
69552025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bddaaf08-553d-47c0-98af-d44d05d9cb8b", "content-length": "729", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69562025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
69572025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c10904-2588-407e-9681-8c24a8a5dbb0", "content-length": "728", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69582025-07-01T00:21:24.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
69592025-07-01T00:21:24.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "256f62fa-006e-4ba7-b549-5f13834addde", "content-length": "722", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69602025-07-01T00:21:24.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
69612025-07-01T00:21:24.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ce32811-cf3b-495f-aa90-db9a8bb92ee7", "content-length": "109", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69622025-07-01T00:21:24.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
69632025-07-01T00:21:24.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b7f3e1-f7e5-46a6-95e8-1309fc474544", "content-length": "109", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69642025-07-01T00:21:24.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
69652025-07-01T00:21:24.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f25f94b6-a95f-4a1b-9cec-090bc89bddcb", "content-length": "169", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69662025-07-01T00:21:24.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
69672025-07-01T00:21:24.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0216b69-dfdf-4a94-9979-294ac73bd04c", "content-length": "169", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69682025-07-01T00:21:24.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
69692025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e88d448-6d64-4f54-b6ae-64a43558ffe2", "content-length": "178", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69702025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
69712025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f2d9e6b-77b7-4d3c-a0c1-d4c3af3e683b", "content-length": "178", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69722025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
69732025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfffb7b6-e11a-41c9-be73-3f67aeaace50", "content-length": "702", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69742025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
69752025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4a6a38a-dcca-4a4e-9ac5-45c2e0110715", "content-length": "727", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69762025-07-01T00:21:24.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
69772025-07-01T00:21:24.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "00349069-d655-4810-b995-47b4c9b60802", "content-length": "729", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69782025-07-01T00:21:24.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
69792025-07-01T00:21:24.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3af5350a-0dd9-4207-87d5-a422d98bf1d5", "content-length": "728", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
69802025-07-01T00:21:24.586ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69812025-07-01T00:21:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69822025-07-01T00:21:24.588ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69832025-07-01T00:21:24.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
69842025-07-01T00:21:24.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69852025-07-01T00:21:24.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69862025-07-01T00:21:24.592ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69872025-07-01T00:21:24.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
69882025-07-01T00:21:24.593ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69892025-07-01T00:21:24.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69902025-07-01T00:21:24.612ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69912025-07-01T00:21:24.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69922025-07-01T00:21:24.614ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 713.258814ms iteration = 21 status = null
69932025-07-01T00:21:24.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69942025-07-01T00:21:24.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69952025-07-01T00:21:24.749ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
69962025-07-01T00:21:24.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69972025-07-01T00:21:24.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69982025-07-01T00:21:24.755ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69992025-07-01T00:21:24.756ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "57e6df20-427c-4c0b-bb22-1c34d2e8c257", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70002025-07-01T00:21:24.756ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70012025-07-01T00:21:24.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ab099efb-4788-41ee-a6bf-77abc91d8099", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70022025-07-01T00:21:24.757ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70032025-07-01T00:21:24.760ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "da9ccc5a-4b53-4031-8f54-825ed7ac4518", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70042025-07-01T00:21:24.760ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70052025-07-01T00:21:24.761ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
70062025-07-01T00:21:24.761ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
70072025-07-01T00:21:24.762ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
70082025-07-01T00:21:24.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 861.16016ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70092025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
70102025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
70112025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70122025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70132025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70142025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70152025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70162025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70172025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70182025-07-01T00:21:24.766ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70192025-07-01T00:21:24.767ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
70202025-07-01T00:21:24.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70212025-07-01T00:21:24.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70222025-07-01T00:21:24.770ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
70232025-07-01T00:21:24.770ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70242025-07-01T00:21:24.836ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fbb782e-a286-47a2-8f65-55fb2017a9fc", "content-length": "88559", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
70252025-07-01T00:21:24.839ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
70262025-07-01T00:21:24.839ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
70272025-07-01T00:21:24.839ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
70282025-07-01T00:21:24.841ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70292025-07-01T00:21:24.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70302025-07-01T00:21:24.843ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70312025-07-01T00:21:24.845ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
70322025-07-01T00:21:24.845ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70332025-07-01T00:21:24.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70342025-07-01T00:21:24.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f130b1dd-d771-40ee-a665-c06062ec84f1", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
70352025-07-01T00:21:24.878ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
70362025-07-01T00:21:24.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70372025-07-01T00:21:24.885ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "129165e0-158a-4eb0-a470-63d5a7095625", "content-length": "682", "date": "Tue, 01 Jul 2025 00:21:24 GMT"} })
70382025-07-01T00:21:24.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70392025-07-01T00:21:24.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70402025-07-01T00:21:24.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70412025-07-01T00:21:24.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70422025-07-01T00:21:24.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70432025-07-01T00:21:24.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70442025-07-01T00:21:24.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70452025-07-01T00:21:24.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70462025-07-01T00:21:24.901ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 998.758805ms iteration = 21 status = {}
70472025-07-01T00:21:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 509 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = e04d28ad-baa3-4e5b-9f98-60f6ba2bbf97 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
70482025-07-01T00:21:25.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 453d9c2b-f8da-44b7-a850-90a18479d78e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
70492025-07-01T00:21:25.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 453d9c2b-f8da-44b7-a850-90a18479d78e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
70502025-07-01T00:21:25.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 453d9c2b-f8da-44b7-a850-90a18479d78e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
70512025-07-01T00:21:25.020ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 3a2907c4-c889-474e-9a80-91524d439d70 file = nexus/db-queries/src/db/datastore/inventory.rs:1378
70522025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 3a2907c4-c889-474e-9a80-91524d439d70 time_started = 2025-07-01 00:21:24.578680 UTC
70532025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
70542025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
70552025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 15 reason = Dependency
70562025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
70572025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70582025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.55\u{b5}s iteration = 15 status = "Disabled"
70592025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70602025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.117290068s iteration = 3 status = {"collection_id":"3a2907c4-c889-474e-9a80-91524d439d70","time_done":"2025-07-01 00:21:24.839406 UTC","time_started":"2025-07-01 00:21:24.578680 UTC"}
70612025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70622025-07-01T00:21:25.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70632025-07-01T00:21:25.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70642025-07-01T00:21:25.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70652025-07-01T00:21:25.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
70662025-07-01T00:21:25.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70672025-07-01T00:21:25.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70682025-07-01T00:21:25.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70692025-07-01T00:21:25.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70702025-07-01T00:21:25.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70712025-07-01T00:21:25.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70722025-07-01T00:21:25.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70732025-07-01T00:21:25.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70742025-07-01T00:21:25.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70752025-07-01T00:21:25.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70762025-07-01T00:21:25.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70772025-07-01T00:21:25.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70782025-07-01T00:21:25.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70792025-07-01T00:21:25.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70802025-07-01T00:21:25.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70812025-07-01T00:21:25.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70822025-07-01T00:21:25.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
70832025-07-01T00:21:25.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70842025-07-01T00:21:25.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70852025-07-01T00:21:25.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70862025-07-01T00:21:25.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
70872025-07-01T00:21:25.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70882025-07-01T00:21:25.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70892025-07-01T00:21:25.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70902025-07-01T00:21:25.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70912025-07-01T00:21:25.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70922025-07-01T00:21:25.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
70932025-07-01T00:21:25.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70942025-07-01T00:21:25.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70952025-07-01T00:21:25.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70962025-07-01T00:21:25.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
70972025-07-01T00:21:25.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
70982025-07-01T00:21:25.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
70992025-07-01T00:21:25.081ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
71002025-07-01T00:21:25.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 61.478462ms iteration = 6 status = {"blueprint_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","inventory_collection_id":"3a2907c4-c889-474e-9a80-91524d439d70","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
71012025-07-01T00:21:25.082ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 62.097808ms iteration = 24 status = {"physical_disks_added":0}
71022025-07-01T00:21:26.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c625506-2dde-4df0-8f19-dc212eecb981 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71032025-07-01T00:21:26.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c625506-2dde-4df0-8f19-dc212eecb981 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71042025-07-01T00:21:26.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c625506-2dde-4df0-8f19-dc212eecb981 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71052025-07-01T00:21:27.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe3ecd4b-1716-43aa-810e-5e80b9e2603d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71062025-07-01T00:21:27.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe3ecd4b-1716-43aa-810e-5e80b9e2603d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71072025-07-01T00:21:27.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe3ecd4b-1716-43aa-810e-5e80b9e2603d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71082025-07-01T00:21:28.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f8e2b8a0-5b0f-4967-b299-03db1dca5f53 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71092025-07-01T00:21:28.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f8e2b8a0-5b0f-4967-b299-03db1dca5f53 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71102025-07-01T00:21:28.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f8e2b8a0-5b0f-4967-b299-03db1dca5f53 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71112025-07-01T00:21:29.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d349f137-b1ab-4ea6-aada-d01542cfb53a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71122025-07-01T00:21:29.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d349f137-b1ab-4ea6-aada-d01542cfb53a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71132025-07-01T00:21:29.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d349f137-b1ab-4ea6-aada-d01542cfb53a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71142025-07-01T00:21:30.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = af751305-3414-4865-bf1c-c4275633a43d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71152025-07-01T00:21:30.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = af751305-3414-4865-bf1c-c4275633a43d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71162025-07-01T00:21:30.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = af751305-3414-4865-bf1c-c4275633a43d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71172025-07-01T00:21:31.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 459a6537-900c-479b-9459-2c7521b470b6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71182025-07-01T00:21:31.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 459a6537-900c-479b-9459-2c7521b470b6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71192025-07-01T00:21:31.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 459a6537-900c-479b-9459-2c7521b470b6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71202025-07-01T00:21:32.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9e3644e-27b6-4385-b78d-9cf7e2f7fa78 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71212025-07-01T00:21:32.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9e3644e-27b6-4385-b78d-9cf7e2f7fa78 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71222025-07-01T00:21:32.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9e3644e-27b6-4385-b78d-9cf7e2f7fa78 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71232025-07-01T00:21:33.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e9ddfb40-df19-448f-b171-048da566fe01 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71242025-07-01T00:21:33.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e9ddfb40-df19-448f-b171-048da566fe01 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71252025-07-01T00:21:33.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e9ddfb40-df19-448f-b171-048da566fe01 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71262025-07-01T00:21:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
71272025-07-01T00:21:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71282025-07-01T00:21:33.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
71292025-07-01T00:21:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71302025-07-01T00:21:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71312025-07-01T00:21:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71322025-07-01T00:21:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71332025-07-01T00:21:33.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71342025-07-01T00:21:33.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71352025-07-01T00:21:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.142283ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71362025-07-01T00:21:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71372025-07-01T00:21:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71382025-07-01T00:21:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71392025-07-01T00:21:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71402025-07-01T00:21:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71412025-07-01T00:21:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71422025-07-01T00:21:33.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
71432025-07-01T00:21:33.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71442025-07-01T00:21:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71452025-07-01T00:21:33.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
71462025-07-01T00:21:33.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.47538ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
71472025-07-01T00:21:34.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5d783323-81fb-4fc8-9e3f-d48f38dab54a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71482025-07-01T00:21:34.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5d783323-81fb-4fc8-9e3f-d48f38dab54a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71492025-07-01T00:21:34.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5d783323-81fb-4fc8-9e3f-d48f38dab54a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71502025-07-01T00:21:34.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 628d923e-189a-4c77-9386-55261cb75414 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
71512025-07-01T00:21:34.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 628d923e-189a-4c77-9386-55261cb75414 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
71522025-07-01T00:21:34.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3000 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 628d923e-189a-4c77-9386-55261cb75414 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
71532025-07-01T00:21:34.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 77b936e1-bfeb-4a10-86d5-ac84bc9aa2dd roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
71542025-07-01T00:21:34.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 77b936e1-bfeb-4a10-86d5-ac84bc9aa2dd resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
71552025-07-01T00:21:34.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 77b936e1-bfeb-4a10-86d5-ac84bc9aa2dd response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
71562025-07-01T00:21:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = e036a52d-d244-48b2-82b9-8b01e27b4854 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
71572025-07-01T00:21:35.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 37149ee2-c58d-4185-a5fa-fa987f5f5478 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71582025-07-01T00:21:35.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 37149ee2-c58d-4185-a5fa-fa987f5f5478 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71592025-07-01T00:21:35.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 37149ee2-c58d-4185-a5fa-fa987f5f5478 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71602025-07-01T00:21:36.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4e3e4138-291e-4e64-8947-cd47248c654d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71612025-07-01T00:21:36.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4e3e4138-291e-4e64-8947-cd47248c654d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71622025-07-01T00:21:36.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4e3e4138-291e-4e64-8947-cd47248c654d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71632025-07-01T00:21:37.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cff74ca9-b9e9-4b11-821f-5f7646199a27 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71642025-07-01T00:21:37.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cff74ca9-b9e9-4b11-821f-5f7646199a27 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71652025-07-01T00:21:37.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cff74ca9-b9e9-4b11-821f-5f7646199a27 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71662025-07-01T00:21:38.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8c005c30-1907-4f1d-b529-f835b959891e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71672025-07-01T00:21:38.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8c005c30-1907-4f1d-b529-f835b959891e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71682025-07-01T00:21:38.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8c005c30-1907-4f1d-b529-f835b959891e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71692025-07-01T00:21:39.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab7f56ef-fdca-49fb-8eeb-3358595ea6d2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71702025-07-01T00:21:39.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab7f56ef-fdca-49fb-8eeb-3358595ea6d2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71712025-07-01T00:21:39.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab7f56ef-fdca-49fb-8eeb-3358595ea6d2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71722025-07-01T00:21:40.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c7b7ff29-bd14-411e-90f6-f7cb462c6334 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71732025-07-01T00:21:40.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c7b7ff29-bd14-411e-90f6-f7cb462c6334 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71742025-07-01T00:21:40.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c7b7ff29-bd14-411e-90f6-f7cb462c6334 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71752025-07-01T00:21:41.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9635d4d6-a9e3-4844-a336-ad8dfc247d22 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71762025-07-01T00:21:41.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9635d4d6-a9e3-4844-a336-ad8dfc247d22 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71772025-07-01T00:21:41.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9635d4d6-a9e3-4844-a336-ad8dfc247d22 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71782025-07-01T00:21:42.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 934262b8-6f03-46aa-85ef-8609e0de7d3d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71792025-07-01T00:21:42.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 934262b8-6f03-46aa-85ef-8609e0de7d3d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71802025-07-01T00:21:42.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 934262b8-6f03-46aa-85ef-8609e0de7d3d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71812025-07-01T00:21:43.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6cf6f90-cae9-426d-8248-180655bc80b7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71822025-07-01T00:21:43.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6cf6f90-cae9-426d-8248-180655bc80b7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71832025-07-01T00:21:43.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e6cf6f90-cae9-426d-8248-180655bc80b7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
71842025-07-01T00:21:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
71852025-07-01T00:21:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71862025-07-01T00:21:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
71872025-07-01T00:21:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71882025-07-01T00:21:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71892025-07-01T00:21:43.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71902025-07-01T00:21:43.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71912025-07-01T00:21:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71922025-07-01T00:21:43.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71932025-07-01T00:21:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.714431ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71942025-07-01T00:21:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71952025-07-01T00:21:43.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71962025-07-01T00:21:43.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71972025-07-01T00:21:43.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71982025-07-01T00:21:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71992025-07-01T00:21:43.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72002025-07-01T00:21:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
72012025-07-01T00:21:43.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72022025-07-01T00:21:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72032025-07-01T00:21:43.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
72042025-07-01T00:21:43.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.885113ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
72052025-07-01T00:21:44.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8fe75d0a-0d6a-4219-9923-56cb26c83e7d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72062025-07-01T00:21:44.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8fe75d0a-0d6a-4219-9923-56cb26c83e7d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72072025-07-01T00:21:44.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8fe75d0a-0d6a-4219-9923-56cb26c83e7d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72082025-07-01T00:21:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 644 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 01566bc2-5bd0-42d2-ba1b-80c7a9e60840 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
72092025-07-01T00:21:45.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7714132e-881e-4b5c-845b-a24446f5614e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72102025-07-01T00:21:45.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7714132e-881e-4b5c-845b-a24446f5614e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72112025-07-01T00:21:45.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7714132e-881e-4b5c-845b-a24446f5614e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72122025-07-01T00:21:46.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0c1752a1-f2bd-4c69-a3d3-afc7aa251bd7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72132025-07-01T00:21:46.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0c1752a1-f2bd-4c69-a3d3-afc7aa251bd7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72142025-07-01T00:21:46.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0c1752a1-f2bd-4c69-a3d3-afc7aa251bd7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72152025-07-01T00:21:47.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6274f983-ec0b-4148-984a-96bc28b9166d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72162025-07-01T00:21:47.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6274f983-ec0b-4148-984a-96bc28b9166d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72172025-07-01T00:21:47.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6274f983-ec0b-4148-984a-96bc28b9166d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72182025-07-01T00:21:48.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7bb7047e-6549-442a-959c-4cc634db723e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72192025-07-01T00:21:48.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7bb7047e-6549-442a-959c-4cc634db723e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72202025-07-01T00:21:48.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7bb7047e-6549-442a-959c-4cc634db723e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72212025-07-01T00:21:49.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e30a1c93-225d-4f4a-882d-46cd2c409f4e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72222025-07-01T00:21:49.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e30a1c93-225d-4f4a-882d-46cd2c409f4e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72232025-07-01T00:21:49.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e30a1c93-225d-4f4a-882d-46cd2c409f4e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72242025-07-01T00:21:50.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab8b792b-c6a3-401e-8619-f2a38aba3c23 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72252025-07-01T00:21:50.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab8b792b-c6a3-401e-8619-f2a38aba3c23 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72262025-07-01T00:21:50.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab8b792b-c6a3-401e-8619-f2a38aba3c23 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72272025-07-01T00:21:51.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8d1c8c19-9f59-4895-9964-0cbcc5d23ee3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72282025-07-01T00:21:51.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8d1c8c19-9f59-4895-9964-0cbcc5d23ee3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72292025-07-01T00:21:51.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8d1c8c19-9f59-4895-9964-0cbcc5d23ee3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72302025-07-01T00:21:52.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 16ff93ce-d2a9-4bed-8e8d-08fef35bcdc0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72312025-07-01T00:21:52.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 16ff93ce-d2a9-4bed-8e8d-08fef35bcdc0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72322025-07-01T00:21:52.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1690 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 16ff93ce-d2a9-4bed-8e8d-08fef35bcdc0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72332025-07-01T00:21:53.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cade0e0e-284c-4606-bf92-a2d06242d7b7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72342025-07-01T00:21:53.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cade0e0e-284c-4606-bf92-a2d06242d7b7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72352025-07-01T00:21:53.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cade0e0e-284c-4606-bf92-a2d06242d7b7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
72362025-07-01T00:21:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
72372025-07-01T00:21:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
72382025-07-01T00:21:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72392025-07-01T00:21:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
72402025-07-01T00:21:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72412025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72422025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72432025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
72442025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
72452025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
72462025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72472025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
72482025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72492025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72502025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72512025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
72522025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72532025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
72542025-07-01T00:21:53.902ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72552025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72562025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
72572025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72582025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
72592025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
72602025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72612025-07-01T00:21:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72622025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
72632025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72642025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72652025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
72662025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72672025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72682025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72692025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72702025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72712025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72722025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72732025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72742025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72752025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72762025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72772025-07-01T00:21:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72782025-07-01T00:21:53.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72792025-07-01T00:21:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 729837424 } })
72802025-07-01T00:21:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
72812025-07-01T00:21:53.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 730280806 } })
72822025-07-01T00:21:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
72832025-07-01T00:21:53.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842025-07-01T00:21:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.759783ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72852025-07-01T00:21:53.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72862025-07-01T00:21:53.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72872025-07-01T00:21:53.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72882025-07-01T00:21:53.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72892025-07-01T00:21:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72902025-07-01T00:21:53.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72912025-07-01T00:21:53.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72922025-07-01T00:21:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72932025-07-01T00:21:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72942025-07-01T00:21:53.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72952025-07-01T00:21:53.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72962025-07-01T00:21:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72972025-07-01T00:21:53.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72982025-07-01T00:21:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72992025-07-01T00:21:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73002025-07-01T00:21:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73012025-07-01T00:21:53.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73022025-07-01T00:21:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73032025-07-01T00:21:53.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.002002ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73042025-07-01T00:21:53.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73052025-07-01T00:21:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73062025-07-01T00:21:53.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73072025-07-01T00:21:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73082025-07-01T00:21:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73092025-07-01T00:21:53.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.361518ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73102025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73112025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73122025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73132025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73142025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73152025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73162025-07-01T00:21:53.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 737634797 } })
73172025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73182025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73192025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73202025-07-01T00:21:53.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
73212025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73222025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
73232025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
73242025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
73252025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73262025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
73272025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73282025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
73292025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73302025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 22 reason = Timeout
73312025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73322025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
73332025-07-01T00:21:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73342025-07-01T00:21:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73352025-07-01T00:21:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73362025-07-01T00:21:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 738468560 } })
73372025-07-01T00:21:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73382025-07-01T00:21:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
73392025-07-01T00:21:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73402025-07-01T00:21:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73412025-07-01T00:21:53.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73422025-07-01T00:21:53.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73432025-07-01T00:21:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73442025-07-01T00:21:53.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73452025-07-01T00:21:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73462025-07-01T00:21:53.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.296882ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
73472025-07-01T00:21:53.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.502889ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
73482025-07-01T00:21:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73492025-07-01T00:21:53.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73502025-07-01T00:21:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73512025-07-01T00:21:53.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73522025-07-01T00:21:53.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73532025-07-01T00:21:53.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73542025-07-01T00:21:53.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73552025-07-01T00:21:53.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562025-07-01T00:21:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73572025-07-01T00:21:53.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73582025-07-01T00:21:53.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73592025-07-01T00:21:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73602025-07-01T00:21:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73612025-07-01T00:21:53.921ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
73622025-07-01T00:21:53.921ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 18.27726ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
73632025-07-01T00:21:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
73642025-07-01T00:21:53.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73652025-07-01T00:21:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73662025-07-01T00:21:53.937ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
73672025-07-01T00:21:53.937ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.623507ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
73682025-07-01T00:21:53.946ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73692025-07-01T00:21:53.946ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73702025-07-01T00:21:53.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73712025-07-01T00:21:53.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73722025-07-01T00:21:53.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73732025-07-01T00:21:53.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73742025-07-01T00:21:53.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73752025-07-01T00:21:53.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73762025-07-01T00:21:53.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73772025-07-01T00:21:53.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73782025-07-01T00:21:53.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73792025-07-01T00:21:53.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73802025-07-01T00:21:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73812025-07-01T00:21:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
73822025-07-01T00:21:53.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73832025-07-01T00:21:53.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73842025-07-01T00:21:53.961ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.525802ms iteration = 22 status = 0
73852025-07-01T00:21:53.966ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73862025-07-01T00:21:53.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.149688ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73872025-07-01T00:21:53.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.497506ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73882025-07-01T00:21:53.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73892025-07-01T00:21:53.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73902025-07-01T00:21:53.970ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 57.906784ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
73912025-07-01T00:21:53.987ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73922025-07-01T00:21:53.987ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73932025-07-01T00:21:53.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73942025-07-01T00:21:53.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73952025-07-01T00:21:53.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.582227ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
73962025-07-01T00:21:54.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
73972025-07-01T00:21:54.016ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73982025-07-01T00:21:54.016ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e579530-c8ee-4ea3-a9da-81de6d0b9337", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
73992025-07-01T00:21:54.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74002025-07-01T00:21:54.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74012025-07-01T00:21:54.028ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74022025-07-01T00:21:54.028ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74032025-07-01T00:21:54.028ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.72263ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74042025-07-01T00:21:54.032ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
74052025-07-01T00:21:54.032ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74062025-07-01T00:21:54.032ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5d85232-733b-4afb-92fe-34092b7b623c", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74072025-07-01T00:21:54.032ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74082025-07-01T00:21:54.035ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
74092025-07-01T00:21:54.039ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.175476ms iteration = 25 status = {"physical_disks_added":0}
74102025-07-01T00:21:54.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
74112025-07-01T00:21:54.046ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74122025-07-01T00:21:54.046ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6916d9d8-1d17-4fcb-a89c-8dfbdf7e8e24", "content-length": "26", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74132025-07-01T00:21:54.046ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74142025-07-01T00:21:54.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74152025-07-01T00:21:54.050ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
74162025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b759d01-0993-4cb1-a733-1b09415701b5", "content-length": "78", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74172025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
74182025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
74192025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
74202025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
74212025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
74222025-07-01T00:21:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
74232025-07-01T00:21:54.053ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
74242025-07-01T00:21:54.053ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
74252025-07-01T00:21:54.053ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
74262025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
74272025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
74282025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
74292025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
74302025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
74312025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
74322025-07-01T00:21:54.056ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
74332025-07-01T00:21:54.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
74342025-07-01T00:21:54.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
74352025-07-01T00:21:54.059ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
74362025-07-01T00:21:54.059ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
74372025-07-01T00:21:54.059ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2ba1afd-daae-478a-a598-c3d031a39124", "content-length": "81", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74382025-07-01T00:21:54.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74392025-07-01T00:21:54.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74402025-07-01T00:21:54.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74412025-07-01T00:21:54.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74422025-07-01T00:21:54.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74432025-07-01T00:21:54.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74442025-07-01T00:21:54.089ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
74452025-07-01T00:21:54.089ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
74462025-07-01T00:21:54.089ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "94fe3a8d-638e-4e31-826c-e171c2edbaa0", "content-length": "81", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74472025-07-01T00:21:54.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74482025-07-01T00:21:54.090ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
74492025-07-01T00:21:54.090ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
74502025-07-01T00:21:54.090ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "62ca763a-732a-4ff2-bbfa-1583d549d34a", "content-length": "81", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74512025-07-01T00:21:54.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74522025-07-01T00:21:54.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74532025-07-01T00:21:54.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74542025-07-01T00:21:54.093ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 180.384235ms iteration = 22 status = {"errors":[],"sps":[]}
74552025-07-01T00:21:54.119ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74562025-07-01T00:21:54.119ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74572025-07-01T00:21:54.119ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "73a0efca-6a74-428d-8098-9c395499c202", "content-length": "372", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74582025-07-01T00:21:54.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74592025-07-01T00:21:54.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74602025-07-01T00:21:54.141ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 239.39622ms iteration = 22 status = {}
74612025-07-01T00:21:54.165ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74622025-07-01T00:21:54.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74632025-07-01T00:21:54.168ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 266.423139ms iteration = 22 status = null
74642025-07-01T00:21:54.181ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74652025-07-01T00:21:54.182ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53a2e5a4-7978-4bb6-b285-2434493ad49e", "content-length": "691", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74662025-07-01T00:21:54.182ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74672025-07-01T00:21:54.182ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74682025-07-01T00:21:54.182ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74692025-07-01T00:21:54.183ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 280.283749ms iteration = 22 status = {}
74702025-07-01T00:21:54.183ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74712025-07-01T00:21:54.183ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74722025-07-01T00:21:54.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "50755eed-04e5-4916-9389-c6919781cf28", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74732025-07-01T00:21:54.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74742025-07-01T00:21:54.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74752025-07-01T00:21:54.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74762025-07-01T00:21:54.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74772025-07-01T00:21:54.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74782025-07-01T00:21:54.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74792025-07-01T00:21:54.196ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74802025-07-01T00:21:54.196ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74812025-07-01T00:21:54.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8a2f2cdf-aea3-42f2-8031-503fbb6a677f", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
74822025-07-01T00:21:54.198ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.378642ms iteration = 22 status = {}
74832025-07-01T00:21:54.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74842025-07-01T00:21:54.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74852025-07-01T00:21:54.236ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
74862025-07-01T00:21:54.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74872025-07-01T00:21:54.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74882025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
74892025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
74902025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74912025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74922025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74932025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74942025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74952025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74962025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74972025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74982025-07-01T00:21:54.249ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
74992025-07-01T00:21:54.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75002025-07-01T00:21:54.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75012025-07-01T00:21:54.252ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
75022025-07-01T00:21:54.252ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75032025-07-01T00:21:54.365ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "df05a27f-70da-4715-a136-0adba657dfd7", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
75042025-07-01T00:21:54.365ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
75052025-07-01T00:21:54.365ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75062025-07-01T00:21:54.365ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "001cb958-2690-494e-87fb-3c0c9bb2aa7b", "content-length": "682", "date": "Tue, 01 Jul 2025 00:21:54 GMT"} })
75072025-07-01T00:21:54.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75082025-07-01T00:21:54.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75092025-07-01T00:21:54.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75102025-07-01T00:21:54.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75112025-07-01T00:21:54.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75122025-07-01T00:21:54.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75132025-07-01T00:21:54.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75142025-07-01T00:21:54.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75152025-07-01T00:21:54.382ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 479.250771ms iteration = 22 status = {}
75162025-07-01T00:21:54.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 06878609-301a-42f6-91d2-cbeddefc00e9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75172025-07-01T00:21:54.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 06878609-301a-42f6-91d2-cbeddefc00e9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75182025-07-01T00:21:54.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 06878609-301a-42f6-91d2-cbeddefc00e9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75192025-07-01T00:21:54.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 570 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 05f30a4c-f0ad-4df0-a60f-bfed0600692e response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
75202025-07-01T00:21:55.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe86d139-dbf5-49a6-9a7d-7ff6ae7669f2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75212025-07-01T00:21:55.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe86d139-dbf5-49a6-9a7d-7ff6ae7669f2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75222025-07-01T00:21:55.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fe86d139-dbf5-49a6-9a7d-7ff6ae7669f2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75232025-07-01T00:21:56.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = adda91b4-d8db-4ac9-a1ca-1f6c4722633a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75242025-07-01T00:21:56.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = adda91b4-d8db-4ac9-a1ca-1f6c4722633a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75252025-07-01T00:21:56.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = adda91b4-d8db-4ac9-a1ca-1f6c4722633a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75262025-07-01T00:21:57.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d5118a5-8e0c-43c0-aeb8-267746850c6f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75272025-07-01T00:21:57.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d5118a5-8e0c-43c0-aeb8-267746850c6f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75282025-07-01T00:21:57.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d5118a5-8e0c-43c0-aeb8-267746850c6f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75292025-07-01T00:21:58.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bdf2308a-0dbd-4967-beb4-a5b7575e155c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75302025-07-01T00:21:58.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bdf2308a-0dbd-4967-beb4-a5b7575e155c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75312025-07-01T00:21:58.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bdf2308a-0dbd-4967-beb4-a5b7575e155c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75322025-07-01T00:21:59.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dafa4416-a13f-4b75-93f0-a9567613e2ce roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75332025-07-01T00:21:59.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dafa4416-a13f-4b75-93f0-a9567613e2ce resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75342025-07-01T00:21:59.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = dafa4416-a13f-4b75-93f0-a9567613e2ce response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75352025-07-01T00:22:00.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c79638d3-b215-4bce-baa4-38b51e3d4312 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75362025-07-01T00:22:00.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c79638d3-b215-4bce-baa4-38b51e3d4312 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75372025-07-01T00:22:00.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c79638d3-b215-4bce-baa4-38b51e3d4312 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75382025-07-01T00:22:01.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9121b193-78d3-4602-a834-0cf30c170623 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75392025-07-01T00:22:01.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9121b193-78d3-4602-a834-0cf30c170623 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75402025-07-01T00:22:01.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9121b193-78d3-4602-a834-0cf30c170623 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75412025-07-01T00:22:02.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6782a1dd-d763-4aa2-b669-0ee517bdd3f5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75422025-07-01T00:22:02.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6782a1dd-d763-4aa2-b669-0ee517bdd3f5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75432025-07-01T00:22:02.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6113 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6782a1dd-d763-4aa2-b669-0ee517bdd3f5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75442025-07-01T00:22:03.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 24abb1ee-5929-49f3-b979-f1d5012c80de roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75452025-07-01T00:22:03.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 24abb1ee-5929-49f3-b979-f1d5012c80de resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75462025-07-01T00:22:03.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 24abb1ee-5929-49f3-b979-f1d5012c80de response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75472025-07-01T00:22:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
75482025-07-01T00:22:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
75492025-07-01T00:22:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75502025-07-01T00:22:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75512025-07-01T00:22:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75522025-07-01T00:22:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75532025-07-01T00:22:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75542025-07-01T00:22:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75552025-07-01T00:22:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75562025-07-01T00:22:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75572025-07-01T00:22:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75582025-07-01T00:22:03.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75592025-07-01T00:22:03.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75602025-07-01T00:22:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
75612025-07-01T00:22:03.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75622025-07-01T00:22:03.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75632025-07-01T00:22:03.929ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
75642025-07-01T00:22:03.929ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.220347ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
75652025-07-01T00:22:03.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75662025-07-01T00:22:03.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75672025-07-01T00:22:03.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.624443ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75682025-07-01T00:22:04.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1d90e46a-8d8d-422c-8653-81c91187a262 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75692025-07-01T00:22:04.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1d90e46a-8d8d-422c-8653-81c91187a262 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75702025-07-01T00:22:04.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1d90e46a-8d8d-422c-8653-81c91187a262 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75712025-07-01T00:22:04.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 69426f74-5314-4b4b-905d-bce869a6d804 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
75722025-07-01T00:22:04.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 69426f74-5314-4b4b-905d-bce869a6d804 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
75732025-07-01T00:22:04.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2721 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 69426f74-5314-4b4b-905d-bce869a6d804 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
75742025-07-01T00:22:04.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 458a6f1c-5588-48ca-9236-bab13932928f roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
75752025-07-01T00:22:04.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 458a6f1c-5588-48ca-9236-bab13932928f resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
75762025-07-01T00:22:04.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 458a6f1c-5588-48ca-9236-bab13932928f response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
75772025-07-01T00:22:04.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = dde370a9-6592-4189-a3e7-49c9aba3f6ec response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
75782025-07-01T00:22:05.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9937494-742e-4de2-b052-43b662855fbb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75792025-07-01T00:22:05.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9937494-742e-4de2-b052-43b662855fbb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75802025-07-01T00:22:05.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b9937494-742e-4de2-b052-43b662855fbb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75812025-07-01T00:22:06.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 961d5bc3-23e6-4f5a-b533-083b043b0004 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75822025-07-01T00:22:06.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 961d5bc3-23e6-4f5a-b533-083b043b0004 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75832025-07-01T00:22:06.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1714 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 961d5bc3-23e6-4f5a-b533-083b043b0004 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75842025-07-01T00:22:07.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1daabc81-4925-4155-b2c8-300651ec3eb3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75852025-07-01T00:22:07.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1daabc81-4925-4155-b2c8-300651ec3eb3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75862025-07-01T00:22:07.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1daabc81-4925-4155-b2c8-300651ec3eb3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75872025-07-01T00:22:08.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 347c5e83-fd8a-48db-b00d-74c5cabc6f3f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75882025-07-01T00:22:08.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 347c5e83-fd8a-48db-b00d-74c5cabc6f3f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75892025-07-01T00:22:08.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1918 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 347c5e83-fd8a-48db-b00d-74c5cabc6f3f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75902025-07-01T00:22:09.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0c85a435-281f-4a2f-9bdd-5ff95902d9f1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75912025-07-01T00:22:09.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0c85a435-281f-4a2f-9bdd-5ff95902d9f1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75922025-07-01T00:22:09.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0c85a435-281f-4a2f-9bdd-5ff95902d9f1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75932025-07-01T00:22:10.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c30fe8e3-638a-44d5-b2d3-dcbf5adc6df8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75942025-07-01T00:22:10.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c30fe8e3-638a-44d5-b2d3-dcbf5adc6df8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75952025-07-01T00:22:10.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c30fe8e3-638a-44d5-b2d3-dcbf5adc6df8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75962025-07-01T00:22:11.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d33741e0-fc8e-4379-97cc-0666125278d4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75972025-07-01T00:22:11.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d33741e0-fc8e-4379-97cc-0666125278d4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75982025-07-01T00:22:11.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d33741e0-fc8e-4379-97cc-0666125278d4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
75992025-07-01T00:22:12.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 77c98a49-03d1-40ba-ad9d-cfc52fc2c458 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76002025-07-01T00:22:12.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 77c98a49-03d1-40ba-ad9d-cfc52fc2c458 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76012025-07-01T00:22:12.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 77c98a49-03d1-40ba-ad9d-cfc52fc2c458 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76022025-07-01T00:22:13.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0a4a16fa-2015-4e80-be4e-313bdd19c5d1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76032025-07-01T00:22:13.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0a4a16fa-2015-4e80-be4e-313bdd19c5d1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76042025-07-01T00:22:13.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1698 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0a4a16fa-2015-4e80-be4e-313bdd19c5d1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76052025-07-01T00:22:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
76062025-07-01T00:22:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
76072025-07-01T00:22:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76082025-07-01T00:22:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76092025-07-01T00:22:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76102025-07-01T00:22:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76112025-07-01T00:22:13.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76122025-07-01T00:22:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76132025-07-01T00:22:13.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76142025-07-01T00:22:13.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.319901ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76152025-07-01T00:22:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76162025-07-01T00:22:13.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76172025-07-01T00:22:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76182025-07-01T00:22:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76192025-07-01T00:22:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76202025-07-01T00:22:13.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76212025-07-01T00:22:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
76222025-07-01T00:22:13.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76232025-07-01T00:22:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76242025-07-01T00:22:13.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
76252025-07-01T00:22:13.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.28377ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
76262025-07-01T00:22:14.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 372ad009-7453-436f-9dc1-0eeb9dd995a6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76272025-07-01T00:22:14.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 372ad009-7453-436f-9dc1-0eeb9dd995a6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76282025-07-01T00:22:14.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 372ad009-7453-436f-9dc1-0eeb9dd995a6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76292025-07-01T00:22:14.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = fae76462-a5b6-413e-80c5-73a874ef85c8 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
76302025-07-01T00:22:15.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 59446d67-a51a-4c19-a652-fa15bc94b6fc roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76312025-07-01T00:22:15.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 59446d67-a51a-4c19-a652-fa15bc94b6fc resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76322025-07-01T00:22:15.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1762 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 59446d67-a51a-4c19-a652-fa15bc94b6fc response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76332025-07-01T00:22:16.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 93a88e47-5523-4125-8f8e-e788c420602e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76342025-07-01T00:22:16.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 93a88e47-5523-4125-8f8e-e788c420602e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76352025-07-01T00:22:16.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 93a88e47-5523-4125-8f8e-e788c420602e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76362025-07-01T00:22:17.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 831b3879-8977-4fb0-ab15-a4c83ef6b806 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76372025-07-01T00:22:17.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 831b3879-8977-4fb0-ab15-a4c83ef6b806 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76382025-07-01T00:22:17.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 831b3879-8977-4fb0-ab15-a4c83ef6b806 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76392025-07-01T00:22:18.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = aa32a555-5f82-4e76-a738-644f957ce450 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76402025-07-01T00:22:18.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = aa32a555-5f82-4e76-a738-644f957ce450 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76412025-07-01T00:22:18.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = aa32a555-5f82-4e76-a738-644f957ce450 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76422025-07-01T00:22:19.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5bfe731-4f84-48f2-9134-3a9b0caee854 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76432025-07-01T00:22:19.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5bfe731-4f84-48f2-9134-3a9b0caee854 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76442025-07-01T00:22:19.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5bfe731-4f84-48f2-9134-3a9b0caee854 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76452025-07-01T00:22:19.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = fd35c5a4-1387-4378-8d03-bb74e18b42cb roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
76462025-07-01T00:22:19.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = fd35c5a4-1387-4378-8d03-bb74e18b42cb resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
76472025-07-01T00:22:19.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = fd35c5a4-1387-4378-8d03-bb74e18b42cb response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
76482025-07-01T00:22:19.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 2b16dd73-8a42-43ce-8bf8-3cbe20afbacb roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
76492025-07-01T00:22:19.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 2b16dd73-8a42-43ce-8bf8-3cbe20afbacb resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
76502025-07-01T00:22:19.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 2b16dd73-8a42-43ce-8bf8-3cbe20afbacb response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
76512025-07-01T00:22:20.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 257e2ad3-6ff1-40dc-8541-b6a4a3b42585 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76522025-07-01T00:22:20.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 257e2ad3-6ff1-40dc-8541-b6a4a3b42585 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76532025-07-01T00:22:20.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 257e2ad3-6ff1-40dc-8541-b6a4a3b42585 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76542025-07-01T00:22:21.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5ee04d68-9d89-4d12-9072-1244806062c8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76552025-07-01T00:22:21.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5ee04d68-9d89-4d12-9072-1244806062c8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76562025-07-01T00:22:21.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5ee04d68-9d89-4d12-9072-1244806062c8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76572025-07-01T00:22:22.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4c8202f0-fd00-4c90-bb0c-358ae70e3bee roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76582025-07-01T00:22:22.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4c8202f0-fd00-4c90-bb0c-358ae70e3bee resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76592025-07-01T00:22:22.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4c8202f0-fd00-4c90-bb0c-358ae70e3bee response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
76602025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
76612025-07-01T00:22:23.901ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
76622025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.251\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
76632025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
76642025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
76652025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76662025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
76672025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76682025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
76692025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
76702025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76712025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
76722025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
76732025-07-01T00:22:23.901ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:12:23.901634629 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76742025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76752025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
76762025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
76772025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
76782025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76792025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76802025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
76812025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76822025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76832025-07-01T00:22:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76842025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76852025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76862025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76872025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76882025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76892025-07-01T00:22:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 727504690 } })
76902025-07-01T00:22:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 727501460 } })
76912025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
76922025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.09906ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
76932025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
76942025-07-01T00:22:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.164602ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
76952025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 16 reason = Timeout
76962025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
76972025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.05\u{b5}s iteration = 16 status = "Disabled"
76982025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
76992025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
77002025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77012025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
77022025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77032025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77042025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77052025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
77062025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
77072025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
77082025-07-01T00:22:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
77092025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77102025-07-01T00:22:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
77112025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77122025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
77132025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
77142025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77152025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77162025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
77172025-07-01T00:22:23.904ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77182025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77192025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
77202025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77212025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
77222025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77232025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
77242025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77252025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
77262025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77272025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
77282025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77292025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77302025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77312025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
77322025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77332025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77342025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77352025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77362025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77372025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77382025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77392025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77402025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77412025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77422025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77432025-07-01T00:22:23.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77442025-07-01T00:22:23.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 730159443 } })
77452025-07-01T00:22:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77462025-07-01T00:22:23.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
77472025-07-01T00:22:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77482025-07-01T00:22:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77492025-07-01T00:22:23.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 730786950 } })
77502025-07-01T00:22:23.905ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:12:23.901634629 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77512025-07-01T00:22:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.990059ms iteration = 12 status = {"expiration":"2025-07-01T00:12:23.901634629Z","pruned":[]}
77522025-07-01T00:22:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77532025-07-01T00:22:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.217185ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77542025-07-01T00:22:23.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
77552025-07-01T00:22:23.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77562025-07-01T00:22:23.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77572025-07-01T00:22:23.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77582025-07-01T00:22:23.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77592025-07-01T00:22:23.907ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77602025-07-01T00:22:23.907ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77612025-07-01T00:22:23.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77622025-07-01T00:22:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77632025-07-01T00:22:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77642025-07-01T00:22:23.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77652025-07-01T00:22:23.909ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77662025-07-01T00:22:23.909ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77672025-07-01T00:22:23.909ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.524112ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77682025-07-01T00:22:23.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77692025-07-01T00:22:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77702025-07-01T00:22:23.910ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77712025-07-01T00:22:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77722025-07-01T00:22:23.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77732025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77752025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77762025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77772025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77782025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77792025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77802025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77812025-07-01T00:22:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77822025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77832025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
77842025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
77852025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77862025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
77872025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
77882025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
77892025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
77902025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
77912025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
77922025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77932025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 23 reason = Timeout
77942025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
77952025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
77962025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
77972025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77982025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
77992025-07-01T00:22:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78002025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
78012025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78022025-07-01T00:22:23.914ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 739421356 } })
78032025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
78042025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78052025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
78062025-07-01T00:22:23.914ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78072025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78082025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78092025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78102025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78112025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78122025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78132025-07-01T00:22:23.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78142025-07-01T00:22:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78152025-07-01T00:22:23.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78162025-07-01T00:22:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78172025-07-01T00:22:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78182025-07-01T00:22:23.916ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 741424491 } })
78192025-07-01T00:22:23.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78202025-07-01T00:22:23.916ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
78212025-07-01T00:22:23.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78222025-07-01T00:22:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78232025-07-01T00:22:23.916ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
78242025-07-01T00:22:23.916ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.302501ms iteration = 12 status = {"by_rx":{},"error":null}
78252025-07-01T00:22:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78262025-07-01T00:22:23.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78272025-07-01T00:22:23.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78282025-07-01T00:22:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78292025-07-01T00:22:23.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78302025-07-01T00:22:23.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.38289ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
78312025-07-01T00:22:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78322025-07-01T00:22:23.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78332025-07-01T00:22:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78342025-07-01T00:22:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78352025-07-01T00:22:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.345946ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
78362025-07-01T00:22:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78372025-07-01T00:22:23.920ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78382025-07-01T00:22:23.920ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78392025-07-01T00:22:23.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 16.545563ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78402025-07-01T00:22:23.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78412025-07-01T00:22:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78422025-07-01T00:22:23.922ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
78432025-07-01T00:22:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
78442025-07-01T00:22:23.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78452025-07-01T00:22:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78462025-07-01T00:22:23.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78472025-07-01T00:22:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78482025-07-01T00:22:23.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78492025-07-01T00:22:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78502025-07-01T00:22:23.936ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 22.847595ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
78512025-07-01T00:22:23.953ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78522025-07-01T00:22:23.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78532025-07-01T00:22:23.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.830798ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78542025-07-01T00:22:23.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ed3d80f-fbc5-450d-b32a-5911cc29b200 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
78552025-07-01T00:22:23.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ed3d80f-fbc5-450d-b32a-5911cc29b200 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
78562025-07-01T00:22:23.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ed3d80f-fbc5-450d-b32a-5911cc29b200 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
78572025-07-01T00:22:23.972ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78582025-07-01T00:22:23.972ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78592025-07-01T00:22:23.972ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78602025-07-01T00:22:23.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78612025-07-01T00:22:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78622025-07-01T00:22:23.973ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78632025-07-01T00:22:23.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78642025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78652025-07-01T00:22:23.974ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
78662025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.288443ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78672025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
78682025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
78692025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
78702025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78712025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78722025-07-01T00:22:23.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78732025-07-01T00:22:23.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78742025-07-01T00:22:23.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.815195ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78752025-07-01T00:22:23.976ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 63.332803ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
78762025-07-01T00:22:23.977ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78772025-07-01T00:22:23.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.277715ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78782025-07-01T00:22:23.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78792025-07-01T00:22:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78802025-07-01T00:22:23.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78812025-07-01T00:22:23.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78822025-07-01T00:22:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78832025-07-01T00:22:23.979ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78842025-07-01T00:22:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78852025-07-01T00:22:23.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78862025-07-01T00:22:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78872025-07-01T00:22:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78882025-07-01T00:22:23.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78892025-07-01T00:22:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78902025-07-01T00:22:23.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78912025-07-01T00:22:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78922025-07-01T00:22:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78932025-07-01T00:22:23.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.417562ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78942025-07-01T00:22:23.982ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78952025-07-01T00:22:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78962025-07-01T00:22:23.982ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78972025-07-01T00:22:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78982025-07-01T00:22:23.983ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78992025-07-01T00:22:23.983ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
79002025-07-01T00:22:23.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79012025-07-01T00:22:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79022025-07-01T00:22:23.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.429307ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
79032025-07-01T00:22:23.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79042025-07-01T00:22:23.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79052025-07-01T00:22:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79062025-07-01T00:22:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
79072025-07-01T00:22:23.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79082025-07-01T00:22:23.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79092025-07-01T00:22:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79102025-07-01T00:22:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79112025-07-01T00:22:23.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79122025-07-01T00:22:23.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79132025-07-01T00:22:23.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79142025-07-01T00:22:23.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79152025-07-01T00:22:23.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79162025-07-01T00:22:23.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79172025-07-01T00:22:23.990ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.727753ms iteration = 26 status = {"physical_disks_added":0}
79182025-07-01T00:22:23.991ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79192025-07-01T00:22:23.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79202025-07-01T00:22:23.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79212025-07-01T00:22:23.992ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
79222025-07-01T00:22:23.992ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79232025-07-01T00:22:23.992ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
79242025-07-01T00:22:23.992ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 90.531427ms iteration = 12 status = {"generation":2}
79252025-07-01T00:22:23.992ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79262025-07-01T00:22:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
79272025-07-01T00:22:23.995ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79282025-07-01T00:22:23.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79292025-07-01T00:22:23.995ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79302025-07-01T00:22:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79312025-07-01T00:22:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79322025-07-01T00:22:23.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79332025-07-01T00:22:23.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79342025-07-01T00:22:23.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79352025-07-01T00:22:23.998ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.421473ms iteration = 23 status = 0
79362025-07-01T00:22:24.000ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
79372025-07-01T00:22:24.000ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.305964ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
79382025-07-01T00:22:24.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79392025-07-01T00:22:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79402025-07-01T00:22:24.024ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79412025-07-01T00:22:24.024ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79422025-07-01T00:22:24.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79432025-07-01T00:22:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79442025-07-01T00:22:24.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79452025-07-01T00:22:24.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79462025-07-01T00:22:24.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79472025-07-01T00:22:24.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79482025-07-01T00:22:24.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79492025-07-01T00:22:24.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79502025-07-01T00:22:24.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79512025-07-01T00:22:24.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79522025-07-01T00:22:24.033ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
79532025-07-01T00:22:24.033ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79542025-07-01T00:22:24.033ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
79552025-07-01T00:22:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 131.361264ms iteration = 12 status = {"generation":1}
79562025-07-01T00:22:24.041ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
79572025-07-01T00:22:24.041ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 137.721028ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
79582025-07-01T00:22:24.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.38119ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
79592025-07-01T00:22:24.061ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79602025-07-01T00:22:24.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79612025-07-01T00:22:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79622025-07-01T00:22:24.075ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
79632025-07-01T00:22:24.075ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79642025-07-01T00:22:24.075ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85abd47e-52c8-49b5-bb41-5e0e967eed86", "content-length": "26", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
79652025-07-01T00:22:24.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79662025-07-01T00:22:24.076ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
79672025-07-01T00:22:24.076ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.10136ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79682025-07-01T00:22:24.077ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
79692025-07-01T00:22:24.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79702025-07-01T00:22:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79712025-07-01T00:22:24.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79722025-07-01T00:22:24.083ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
79732025-07-01T00:22:24.083ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79742025-07-01T00:22:24.083ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db63eb36-a150-44bb-ae3b-23e5e53245d7", "content-length": "26", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
79752025-07-01T00:22:24.083ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79762025-07-01T00:22:24.085ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79772025-07-01T00:22:24.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79782025-07-01T00:22:24.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79792025-07-01T00:22:24.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79802025-07-01T00:22:24.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79812025-07-01T00:22:24.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79822025-07-01T00:22:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79832025-07-01T00:22:24.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79842025-07-01T00:22:24.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79852025-07-01T00:22:24.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79862025-07-01T00:22:24.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79872025-07-01T00:22:24.250ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
79882025-07-01T00:22:24.250ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79892025-07-01T00:22:24.251ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd395ac0-0976-4c41-9cd9-2aa4efe294f2", "content-length": "26", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
79902025-07-01T00:22:24.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79912025-07-01T00:22:24.253ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
79922025-07-01T00:22:24.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 349.181264ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
79932025-07-01T00:22:24.253ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79942025-07-01T00:22:24.256ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
79952025-07-01T00:22:24.256ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "055227ac-bf98-4c97-a14b-46b4b2bc461f", "content-length": "78", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
79962025-07-01T00:22:24.256ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
79972025-07-01T00:22:24.256ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
79982025-07-01T00:22:24.256ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
79992025-07-01T00:22:24.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
80002025-07-01T00:22:24.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
80012025-07-01T00:22:24.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
80022025-07-01T00:22:24.259ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
80032025-07-01T00:22:24.259ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
80042025-07-01T00:22:24.259ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
80052025-07-01T00:22:24.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
80062025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
80072025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
80082025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
80092025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
80102025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
80112025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
80122025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
80132025-07-01T00:22:24.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
80142025-07-01T00:22:24.264ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
80152025-07-01T00:22:24.264ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
80162025-07-01T00:22:24.264ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
80172025-07-01T00:22:24.264ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
80182025-07-01T00:22:24.264ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "4024f1b5-3aad-4966-97df-f17b7f7406be", "content-length": "81", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80192025-07-01T00:22:24.265ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "d788a80f-bc4c-4cb3-a3c7-5cbc61f7cb72", "content-length": "81", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80202025-07-01T00:22:24.270ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80212025-07-01T00:22:24.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80222025-07-01T00:22:24.272ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 371.072232ms iteration = 23 status = null
80232025-07-01T00:22:24.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80242025-07-01T00:22:24.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "92a346d3-cf1f-4317-8dd3-a6a2dd6ab3d0", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80252025-07-01T00:22:24.289ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80262025-07-01T00:22:24.290ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2c6f8e96-a636-47e4-8fed-2ba37e91561e", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80272025-07-01T00:22:24.290ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80282025-07-01T00:22:24.292ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80292025-07-01T00:22:24.292ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 391.131591ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80302025-07-01T00:22:24.314ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
80312025-07-01T00:22:24.314ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
80322025-07-01T00:22:24.314ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e36cf974-5808-4c0b-8baf-e90da7cad1ea", "content-length": "81", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80332025-07-01T00:22:24.316ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 402.485052ms iteration = 23 status = {"errors":[],"sps":[]}
80342025-07-01T00:22:24.400ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 499.316391ms iteration = 23 status = {}
80352025-07-01T00:22:24.415ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80362025-07-01T00:22:24.431ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80372025-07-01T00:22:24.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80382025-07-01T00:22:24.432ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80392025-07-01T00:22:24.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f0fb2e7-a5c2-4e41-9241-e759a26012bc", "content-length": "372", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80402025-07-01T00:22:24.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80412025-07-01T00:22:24.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b020b5d5-a8ce-4708-9376-69525593292d", "content-length": "691", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80422025-07-01T00:22:24.432ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80432025-07-01T00:22:24.432ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80442025-07-01T00:22:24.432ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80452025-07-01T00:22:24.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80462025-07-01T00:22:24.433ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.883387ms iteration = 23 status = {}
80472025-07-01T00:22:24.445ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80482025-07-01T00:22:24.445ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80492025-07-01T00:22:24.445ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f9892080-dc6f-43e1-b739-45f3406d9d8c", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80502025-07-01T00:22:24.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80512025-07-01T00:22:24.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80522025-07-01T00:22:24.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80532025-07-01T00:22:24.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80542025-07-01T00:22:24.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80552025-07-01T00:22:24.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80562025-07-01T00:22:24.454ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80572025-07-01T00:22:24.454ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80582025-07-01T00:22:24.454ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "024811f3-efe7-4840-99b8-11f5745bf36c", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80592025-07-01T00:22:24.457ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 553.39588ms iteration = 23 status = {}
80602025-07-01T00:22:24.468ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80612025-07-01T00:22:24.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c213528a-2cac-4f1f-bf67-aa960cf9748f", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80622025-07-01T00:22:24.468ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80632025-07-01T00:22:24.470ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7f2fedc9-b658-434c-acc9-ba6f79d032d7", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80642025-07-01T00:22:24.470ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80652025-07-01T00:22:24.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "833bbf07-129d-42b2-b9af-10d3de100dc1", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80662025-07-01T00:22:24.473ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80672025-07-01T00:22:24.475ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80682025-07-01T00:22:24.475ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.706306ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80692025-07-01T00:22:24.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80702025-07-01T00:22:24.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80712025-07-01T00:22:24.504ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
80722025-07-01T00:22:24.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80732025-07-01T00:22:24.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80742025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
80752025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
80762025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80772025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80782025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80792025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80802025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80812025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80822025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80832025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80842025-07-01T00:22:24.514ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
80852025-07-01T00:22:24.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80862025-07-01T00:22:24.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80872025-07-01T00:22:24.517ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
80882025-07-01T00:22:24.517ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80892025-07-01T00:22:24.616ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0f1b6c56-f271-4711-acd4-2a72b142c26b", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80902025-07-01T00:22:24.616ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
80912025-07-01T00:22:24.616ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80922025-07-01T00:22:24.617ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d3f215a-d269-4306-8474-fe9c865fd646", "content-length": "682", "date": "Tue, 01 Jul 2025 00:22:24 GMT"} })
80932025-07-01T00:22:24.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80942025-07-01T00:22:24.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80952025-07-01T00:22:24.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80962025-07-01T00:22:24.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80972025-07-01T00:22:24.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80982025-07-01T00:22:24.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80992025-07-01T00:22:24.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81002025-07-01T00:22:24.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81012025-07-01T00:22:24.633ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.037003ms iteration = 23 status = {}
81022025-07-01T00:22:24.820ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
81032025-07-01T00:22:24.820ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
81042025-07-01T00:22:24.851ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
81052025-07-01T00:22:24.851ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:59033
81062025-07-01T00:22:24.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:59033 req_id = e9c6f7a3-0629-4970-95bf-83c960758ed6 roles = RoleSet { roles: {} } uri = /metrics/producers
81072025-07-01T00:22:24.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:59033 req_id = e9c6f7a3-0629-4970-95bf-83c960758ed6 resource = Database result = Ok(()) uri = /metrics/producers
81082025-07-01T00:22:24.889ZINFOnexus: assigned collector to new producer collector_id = a8a4439d-9bed-4df3-9921-c50bfb72fc42 file = nexus/src/app/oximeter.rs:76 producer_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
81092025-07-01T00:22:24.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 38156 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:59033 req_id = e9c6f7a3-0629-4970-95bf-83c960758ed6 response_code = 201 uri = /metrics/producers
81102025-07-01T00:22:24.889ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e9c6f7a3-0629-4970-95bf-83c960758ed6", "content-length": "41", "date": "Tue, 01 Jul 2025 00:22:23 GMT"} })
81112025-07-01T00:22:24.890ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
81122025-07-01T00:22:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 475 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 9dce0015-c26b-4034-8b4d-b609603c24cb response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
81132025-07-01T00:22:24.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39f63510-0c8b-48bf-ab47-a98c7b6fde10 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81142025-07-01T00:22:24.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39f63510-0c8b-48bf-ab47-a98c7b6fde10 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81152025-07-01T00:22:24.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 39f63510-0c8b-48bf-ab47-a98c7b6fde10 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81162025-07-01T00:22:26.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d8bdc65-6018-432d-a826-741ff46a5794 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81172025-07-01T00:22:26.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d8bdc65-6018-432d-a826-741ff46a5794 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81182025-07-01T00:22:26.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2784 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3d8bdc65-6018-432d-a826-741ff46a5794 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81192025-07-01T00:22:27.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 97f91acc-4bce-421c-b826-74a3ba72284b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81202025-07-01T00:22:27.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 97f91acc-4bce-421c-b826-74a3ba72284b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81212025-07-01T00:22:27.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 97f91acc-4bce-421c-b826-74a3ba72284b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81222025-07-01T00:22:28.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c88b994-aa90-4351-9d74-30354055b130 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81232025-07-01T00:22:28.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c88b994-aa90-4351-9d74-30354055b130 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81242025-07-01T00:22:28.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1c88b994-aa90-4351-9d74-30354055b130 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81252025-07-01T00:22:29.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 36fddaf8-422c-4833-82b2-e9e0a1851f32 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81262025-07-01T00:22:29.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 36fddaf8-422c-4833-82b2-e9e0a1851f32 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81272025-07-01T00:22:29.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2800 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 36fddaf8-422c-4833-82b2-e9e0a1851f32 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81282025-07-01T00:22:30.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = de1076d3-d4af-487c-85ab-9888d5dde15a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81292025-07-01T00:22:30.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = de1076d3-d4af-487c-85ab-9888d5dde15a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81302025-07-01T00:22:30.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = de1076d3-d4af-487c-85ab-9888d5dde15a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81312025-07-01T00:22:31.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e25f5614-d02a-4779-96fc-0bbd52a7c7a2 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81322025-07-01T00:22:31.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e25f5614-d02a-4779-96fc-0bbd52a7c7a2 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81332025-07-01T00:22:31.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e25f5614-d02a-4779-96fc-0bbd52a7c7a2 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81342025-07-01T00:22:32.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0cf2f5a9-59e4-47e9-b2fe-1fff7f93cf74 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81352025-07-01T00:22:32.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0cf2f5a9-59e4-47e9-b2fe-1fff7f93cf74 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81362025-07-01T00:22:32.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0cf2f5a9-59e4-47e9-b2fe-1fff7f93cf74 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81372025-07-01T00:22:33.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ab99645-44f0-47fc-8ed4-6718e44b5c9a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81382025-07-01T00:22:33.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ab99645-44f0-47fc-8ed4-6718e44b5c9a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81392025-07-01T00:22:33.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ab99645-44f0-47fc-8ed4-6718e44b5c9a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81402025-07-01T00:22:33.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
81412025-07-01T00:22:33.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81422025-07-01T00:22:33.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
81432025-07-01T00:22:33.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81442025-07-01T00:22:33.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81452025-07-01T00:22:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81462025-07-01T00:22:33.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81472025-07-01T00:22:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81482025-07-01T00:22:33.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81492025-07-01T00:22:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.164804ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81502025-07-01T00:22:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81512025-07-01T00:22:33.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81522025-07-01T00:22:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81532025-07-01T00:22:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542025-07-01T00:22:33.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81552025-07-01T00:22:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81562025-07-01T00:22:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
81572025-07-01T00:22:33.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81582025-07-01T00:22:33.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81592025-07-01T00:22:33.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
81602025-07-01T00:22:33.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.225965ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
81612025-07-01T00:22:34.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2f9b340f-336a-4472-8cbc-d4c94afd0401 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81622025-07-01T00:22:34.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2f9b340f-336a-4472-8cbc-d4c94afd0401 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81632025-07-01T00:22:34.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2f9b340f-336a-4472-8cbc-d4c94afd0401 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81642025-07-01T00:22:34.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = c896fc3e-eb55-4530-8547-78cc580fe2ae roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
81652025-07-01T00:22:34.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = c896fc3e-eb55-4530-8547-78cc580fe2ae resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
81662025-07-01T00:22:34.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3515 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = c896fc3e-eb55-4530-8547-78cc580fe2ae response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
81672025-07-01T00:22:34.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 8440ff0a-6623-4e33-963f-9f84e88365c5 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
81682025-07-01T00:22:34.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 8440ff0a-6623-4e33-963f-9f84e88365c5 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
81692025-07-01T00:22:34.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 178a572c-67e5-43e7-8b85-9c52c0251452 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
81702025-07-01T00:22:34.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 8440ff0a-6623-4e33-963f-9f84e88365c5 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
81712025-07-01T00:22:35.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fc89f5f7-d9a1-4190-a122-9c962706f9c3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81722025-07-01T00:22:35.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fc89f5f7-d9a1-4190-a122-9c962706f9c3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81732025-07-01T00:22:35.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fc89f5f7-d9a1-4190-a122-9c962706f9c3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81742025-07-01T00:22:36.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b18a6b39-b3d1-42b8-b554-d1536b061e8c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81752025-07-01T00:22:36.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b18a6b39-b3d1-42b8-b554-d1536b061e8c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81762025-07-01T00:22:36.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b18a6b39-b3d1-42b8-b554-d1536b061e8c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81772025-07-01T00:22:37.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3ee1826c-fc38-49c4-8cef-314b269f8020 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81782025-07-01T00:22:37.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3ee1826c-fc38-49c4-8cef-314b269f8020 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81792025-07-01T00:22:37.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2820 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3ee1826c-fc38-49c4-8cef-314b269f8020 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81802025-07-01T00:22:38.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f8ed7d91-a0de-4c22-b7ac-1b67e463f8cc roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81812025-07-01T00:22:38.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f8ed7d91-a0de-4c22-b7ac-1b67e463f8cc resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81822025-07-01T00:22:38.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f8ed7d91-a0de-4c22-b7ac-1b67e463f8cc response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81832025-07-01T00:22:39.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 564aa0e5-6180-4d23-9fde-106db68e27fa roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81842025-07-01T00:22:39.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 564aa0e5-6180-4d23-9fde-106db68e27fa resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81852025-07-01T00:22:39.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 564aa0e5-6180-4d23-9fde-106db68e27fa response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81862025-07-01T00:22:40.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 171b797d-3c9a-446f-8a45-2ec66b6a19a8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81872025-07-01T00:22:40.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 171b797d-3c9a-446f-8a45-2ec66b6a19a8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81882025-07-01T00:22:40.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 171b797d-3c9a-446f-8a45-2ec66b6a19a8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81892025-07-01T00:22:41.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 46c8ef44-06b1-4a02-8557-92cd008ab22f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81902025-07-01T00:22:41.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 46c8ef44-06b1-4a02-8557-92cd008ab22f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81912025-07-01T00:22:41.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 46c8ef44-06b1-4a02-8557-92cd008ab22f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81922025-07-01T00:22:42.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b15f4599-651f-4fe5-8ca2-307d2f79be73 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81932025-07-01T00:22:42.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b15f4599-651f-4fe5-8ca2-307d2f79be73 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81942025-07-01T00:22:42.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b15f4599-651f-4fe5-8ca2-307d2f79be73 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81952025-07-01T00:22:43.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 971fc597-1827-4121-8a7f-e0457d14dcce roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81962025-07-01T00:22:43.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 971fc597-1827-4121-8a7f-e0457d14dcce resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81972025-07-01T00:22:43.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 971fc597-1827-4121-8a7f-e0457d14dcce response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
81982025-07-01T00:22:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
81992025-07-01T00:22:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
82002025-07-01T00:22:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82012025-07-01T00:22:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82022025-07-01T00:22:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82032025-07-01T00:22:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82042025-07-01T00:22:43.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82052025-07-01T00:22:43.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82062025-07-01T00:22:43.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82072025-07-01T00:22:43.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82082025-07-01T00:22:43.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82092025-07-01T00:22:43.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82102025-07-01T00:22:43.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82112025-07-01T00:22:43.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
82122025-07-01T00:22:43.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82132025-07-01T00:22:43.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82142025-07-01T00:22:43.929ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
82152025-07-01T00:22:43.929ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.469677ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
82162025-07-01T00:22:43.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82172025-07-01T00:22:43.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82182025-07-01T00:22:43.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.340795ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82192025-07-01T00:22:44.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4ab1f162-3019-4b89-8023-f0b766933791 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82202025-07-01T00:22:44.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4ab1f162-3019-4b89-8023-f0b766933791 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82212025-07-01T00:22:44.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4ab1f162-3019-4b89-8023-f0b766933791 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82222025-07-01T00:22:44.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 2d4a73d4-048b-41c7-8ec8-a085e6d008e7 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
82232025-07-01T00:22:45.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e832598c-b1b1-4a4e-ac4f-289a17072ce3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82242025-07-01T00:22:45.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e832598c-b1b1-4a4e-ac4f-289a17072ce3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82252025-07-01T00:22:45.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e832598c-b1b1-4a4e-ac4f-289a17072ce3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82262025-07-01T00:22:46.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6b3b99e3-9ca1-455d-9738-1fb969356dde roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82272025-07-01T00:22:46.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6b3b99e3-9ca1-455d-9738-1fb969356dde resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82282025-07-01T00:22:46.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6b3b99e3-9ca1-455d-9738-1fb969356dde response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82292025-07-01T00:22:47.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9a7f02be-7ca2-46dd-b753-7431455aea56 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82302025-07-01T00:22:47.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9a7f02be-7ca2-46dd-b753-7431455aea56 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82312025-07-01T00:22:47.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9a7f02be-7ca2-46dd-b753-7431455aea56 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82322025-07-01T00:22:48.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e2a29b65-3165-4fe1-ab9e-442d44b99529 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82332025-07-01T00:22:48.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e2a29b65-3165-4fe1-ab9e-442d44b99529 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82342025-07-01T00:22:48.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e2a29b65-3165-4fe1-ab9e-442d44b99529 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82352025-07-01T00:22:49.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d64c30a7-b46c-4e1f-822a-82159c93df35 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82362025-07-01T00:22:49.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d64c30a7-b46c-4e1f-822a-82159c93df35 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82372025-07-01T00:22:49.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d64c30a7-b46c-4e1f-822a-82159c93df35 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82382025-07-01T00:22:50.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f58cf392-d951-4d31-a852-67defe10706f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82392025-07-01T00:22:50.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f58cf392-d951-4d31-a852-67defe10706f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82402025-07-01T00:22:50.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f58cf392-d951-4d31-a852-67defe10706f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82412025-07-01T00:22:50.614ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 874a2cf9-66eb-4a4f-b078-114dd6dab2ed uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-07-01T00:22:50.598405343Z }
82422025-07-01T00:22:50.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 874a2cf9-66eb-4a4f-b078-114dd6dab2ed roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
82432025-07-01T00:22:50.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 874a2cf9-66eb-4a4f-b078-114dd6dab2ed resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
82442025-07-01T00:22:50.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 86164 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 874a2cf9-66eb-4a4f-b078-114dd6dab2ed response_code = 204 uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
82452025-07-01T00:22:50.685ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab5a7090-cd2e-4c5b-b84b-5c29def5938a uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-01T00:22:50.685148057Z }
82462025-07-01T00:22:50.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab5a7090-cd2e-4c5b-b84b-5c29def5938a roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
82472025-07-01T00:22:50.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab5a7090-cd2e-4c5b-b84b-5c29def5938a resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
82482025-07-01T00:22:50.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 55426 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ab5a7090-cd2e-4c5b-b84b-5c29def5938a response_code = 204 uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
82492025-07-01T00:22:51.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8377b671-0851-4140-8e82-40af24bfd266 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82502025-07-01T00:22:51.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8377b671-0851-4140-8e82-40af24bfd266 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82512025-07-01T00:22:51.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8377b671-0851-4140-8e82-40af24bfd266 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82522025-07-01T00:22:52.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 08a9e79a-fb71-45a0-8d55-5a880f0e2ae3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82532025-07-01T00:22:52.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 08a9e79a-fb71-45a0-8d55-5a880f0e2ae3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82542025-07-01T00:22:52.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2645 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 08a9e79a-fb71-45a0-8d55-5a880f0e2ae3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82552025-07-01T00:22:53.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45b9ea67-1f0e-4121-a083-ec2f7cf5c96b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82562025-07-01T00:22:53.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45b9ea67-1f0e-4121-a083-ec2f7cf5c96b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82572025-07-01T00:22:53.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 45b9ea67-1f0e-4121-a083-ec2f7cf5c96b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
82582025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
82592025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
82602025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82612025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
82622025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82632025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82642025-07-01T00:22:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82652025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
82662025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82672025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82682025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
82692025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
82702025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82712025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
82722025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82732025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82742025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
82752025-07-01T00:22:53.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82762025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82772025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
82782025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
82792025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82802025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82812025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
82822025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82832025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
82842025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82852025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
82862025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
82872025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82882025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82892025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82902025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82912025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82922025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82932025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82942025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82952025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82962025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82972025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82982025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82992025-07-01T00:22:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83002025-07-01T00:22:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 729777242 } })
83012025-07-01T00:22:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 729991208 } })
83022025-07-01T00:22:53.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
83032025-07-01T00:22:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.034471ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83042025-07-01T00:22:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
83052025-07-01T00:22:53.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83062025-07-01T00:22:53.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83072025-07-01T00:22:53.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83082025-07-01T00:22:53.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83092025-07-01T00:22:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83102025-07-01T00:22:53.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83112025-07-01T00:22:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83122025-07-01T00:22:53.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83132025-07-01T00:22:53.909ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83142025-07-01T00:22:53.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83152025-07-01T00:22:53.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83162025-07-01T00:22:53.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83172025-07-01T00:22:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83182025-07-01T00:22:53.911ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 736538867 } })
83192025-07-01T00:22:53.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202025-07-01T00:22:53.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
83212025-07-01T00:22:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83222025-07-01T00:22:53.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83232025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83242025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83252025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83262025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83272025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83282025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83292025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83302025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83312025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83322025-07-01T00:22:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83332025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83342025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
83352025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83362025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
83372025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83382025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
83392025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
83402025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83412025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
83422025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 24 reason = Timeout
83432025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
83442025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83452025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83462025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83472025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
83482025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83492025-07-01T00:22:53.913ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1703, tv_nsec: 738592454 } })
83502025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83512025-07-01T00:22:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83522025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83532025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83542025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83552025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83562025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83572025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83582025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.543725ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83592025-07-01T00:22:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83602025-07-01T00:22:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83612025-07-01T00:22:53.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83622025-07-01T00:22:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83632025-07-01T00:22:53.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83642025-07-01T00:22:53.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83652025-07-01T00:22:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83662025-07-01T00:22:53.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83672025-07-01T00:22:53.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83682025-07-01T00:22:53.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83692025-07-01T00:22:53.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83702025-07-01T00:22:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
83712025-07-01T00:22:53.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83722025-07-01T00:22:53.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83732025-07-01T00:22:53.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.703129ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83742025-07-01T00:22:53.941ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
83752025-07-01T00:22:53.941ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.203876ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
83762025-07-01T00:22:53.942ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83772025-07-01T00:22:53.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83782025-07-01T00:22:53.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.583191ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
83792025-07-01T00:22:53.954ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83802025-07-01T00:22:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83812025-07-01T00:22:53.955ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83822025-07-01T00:22:53.955ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83832025-07-01T00:22:53.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83842025-07-01T00:22:53.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83852025-07-01T00:22:53.956ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83862025-07-01T00:22:53.957ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83872025-07-01T00:22:53.957ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83882025-07-01T00:22:53.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83892025-07-01T00:22:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83902025-07-01T00:22:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83912025-07-01T00:22:53.958ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83922025-07-01T00:22:53.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83932025-07-01T00:22:53.959ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 46.490982ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
83942025-07-01T00:22:53.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.086917ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
83952025-07-01T00:22:53.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83962025-07-01T00:22:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83972025-07-01T00:22:53.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83982025-07-01T00:22:53.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83992025-07-01T00:22:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84002025-07-01T00:22:53.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84012025-07-01T00:22:53.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84022025-07-01T00:22:53.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84032025-07-01T00:22:53.971ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84042025-07-01T00:22:53.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84052025-07-01T00:22:53.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84062025-07-01T00:22:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
84072025-07-01T00:22:53.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84082025-07-01T00:22:53.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84092025-07-01T00:22:53.976ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.561192ms iteration = 27 status = {"physical_disks_added":0}
84102025-07-01T00:22:53.977ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.319574ms iteration = 24 status = 0
84112025-07-01T00:22:53.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.093725ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84122025-07-01T00:22:54.006ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
84132025-07-01T00:22:54.006ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 103.43903ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
84142025-07-01T00:22:54.009ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84152025-07-01T00:22:54.009ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84162025-07-01T00:22:54.009ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.35927ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84172025-07-01T00:22:54.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.539781ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84182025-07-01T00:22:54.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84192025-07-01T00:22:54.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84202025-07-01T00:22:54.080ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
84212025-07-01T00:22:54.080ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84222025-07-01T00:22:54.080ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e13a820-f37c-4133-b7b6-539ebf033efe", "content-length": "26", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84232025-07-01T00:22:54.080ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84242025-07-01T00:22:54.082ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
84252025-07-01T00:22:54.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84262025-07-01T00:22:54.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84272025-07-01T00:22:54.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282025-07-01T00:22:54.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84292025-07-01T00:22:54.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84302025-07-01T00:22:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84312025-07-01T00:22:54.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84322025-07-01T00:22:54.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84332025-07-01T00:22:54.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84342025-07-01T00:22:54.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84352025-07-01T00:22:54.177ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
84362025-07-01T00:22:54.177ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84372025-07-01T00:22:54.177ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e9a4fc-0900-409a-9952-bac92be18154", "content-length": "26", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84382025-07-01T00:22:54.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84392025-07-01T00:22:54.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84402025-07-01T00:22:54.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
84412025-07-01T00:22:54.205ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84422025-07-01T00:22:54.206ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f83ef653-0269-42ae-825a-0656769caba6", "content-length": "26", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84432025-07-01T00:22:54.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84442025-07-01T00:22:54.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84452025-07-01T00:22:54.218ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b/state
84462025-07-01T00:22:54.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "0818d26d-53f8-4363-a227-b9a4f8e7d0a1", "content-length": "130", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84472025-07-01T00:22:54.232ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade sled_id = 887ec56b-486c-42d4-930b-b7b47cbacc61 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-01T00:22:50.685148057Z }, migration_in: None, migration_out: None } vmm_id = cc5a3736-e42c-4397-9487-05e4538b9f0b
84482025-07-01T00:22:54.232ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2140 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b sled_id = 887ec56b-486c-42d4-930b-b7b47cbacc61 vmm_id = cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-01T00:22:50.685148057Z }
84492025-07-01T00:22:54.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade roles = RoleSet { roles: {} } sled_id = 887ec56b-486c-42d4-930b-b7b47cbacc61 vmm_id = cc5a3736-e42c-4397-9487-05e4538b9f0b
84502025-07-01T00:22:54.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade resource = Database result = Ok(()) sled_id = 887ec56b-486c-42d4-930b-b7b47cbacc61 vmm_id = cc5a3736-e42c-4397-9487-05e4538b9f0b
84512025-07-01T00:22:54.238ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
84522025-07-01T00:22:54.240ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 337.151074ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
84532025-07-01T00:22:54.247ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
84542025-07-01T00:22:54.247ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf7f3e4a-8bb6-4ad3-8425-f8013a4a6d6e", "content-length": "78", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84552025-07-01T00:22:54.247ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
84562025-07-01T00:22:54.247ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
84572025-07-01T00:22:54.247ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
84582025-07-01T00:22:54.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
84592025-07-01T00:22:54.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
84602025-07-01T00:22:54.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
84612025-07-01T00:22:54.249ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
84622025-07-01T00:22:54.249ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
84632025-07-01T00:22:54.250ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
84642025-07-01T00:22:54.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
84652025-07-01T00:22:54.252ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
84662025-07-01T00:22:54.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
84672025-07-01T00:22:54.254ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84682025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84692025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
84702025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
84712025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd0b79a-2210-45fe-b8c1-64164df5a5b8", "content-length": "585", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84722025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84732025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
84742025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
84752025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
84762025-07-01T00:22:54.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
84772025-07-01T00:22:54.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84782025-07-01T00:22:54.256ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
84792025-07-01T00:22:54.256ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
84802025-07-01T00:22:54.257ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
84812025-07-01T00:22:54.257ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
84822025-07-01T00:22:54.257ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c817ca12-ba1d-4d62-9bde-1e5414c5ba5d", "content-length": "81", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84832025-07-01T00:22:54.257ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6fdc5e1-f3ad-4702-9c3f-26062bfe364b", "content-length": "81", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84842025-07-01T00:22:54.301ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
84852025-07-01T00:22:54.301ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
84862025-07-01T00:22:54.301ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0899b245-7c7d-4abb-bc83-76ed561c4fd4", "content-length": "81", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84872025-07-01T00:22:54.303ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 390.590906ms iteration = 24 status = {"errors":[],"sps":[]}
84882025-07-01T00:22:54.308ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {47d4f7d9-1e14-496d-9110-6c5b068ef747: {10.151.1.175: {d13aa361-9360-415b-ab25-36de2f6f7176}, 10.151.1.176: {d13aa361-9360-415b-ab25-36de2f6f7176}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84892025-07-01T00:22:54.308ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84902025-07-01T00:22:54.309ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8970d0bb-ae7c-4b23-8e7a-e6ecbbd15286", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
84912025-07-01T00:22:54.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84922025-07-01T00:22:54.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84932025-07-01T00:22:54.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84942025-07-01T00:22:54.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84952025-07-01T00:22:54.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84962025-07-01T00:22:54.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84972025-07-01T00:22:54.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84982025-07-01T00:22:54.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84992025-07-01T00:22:54.322ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 421.463631ms iteration = 24 status = {}
85002025-07-01T00:22:54.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85012025-07-01T00:22:54.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85022025-07-01T00:22:54.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85032025-07-01T00:22:54.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85042025-07-01T00:22:54.330ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85052025-07-01T00:22:54.330ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85062025-07-01T00:22:54.330ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85072025-07-01T00:22:54.331ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ad9659dc-8666-4fcd-9519-49a8252eca82", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
85082025-07-01T00:22:54.333ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 429.952902ms iteration = 24 status = {}
85092025-07-01T00:22:54.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85102025-07-01T00:22:54.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85112025-07-01T00:22:54.351ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 450.272559ms iteration = 24 status = null
85122025-07-01T00:22:54.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85132025-07-01T00:22:54.369ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0b12230-70f4-4a3d-bba3-7cd69a1d972a", "content-length": "811", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
85142025-07-01T00:22:54.369ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14222093) }} sled = buskin
85152025-07-01T00:22:54.369ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85162025-07-01T00:22:54.369ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85172025-07-01T00:22:54.371ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 468.770605ms iteration = 24 status = {}
85182025-07-01T00:22:54.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85192025-07-01T00:22:54.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85202025-07-01T00:22:54.430ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
85212025-07-01T00:22:54.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85222025-07-01T00:22:54.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85232025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
85242025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
85252025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85262025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85272025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85282025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85292025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85302025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85312025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85322025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85332025-07-01T00:22:54.445ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
85342025-07-01T00:22:54.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85352025-07-01T00:22:54.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85362025-07-01T00:22:54.448ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
85372025-07-01T00:22:54.448ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85382025-07-01T00:22:54.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ac6613ac-8d23-4b2c-aaca-55efb7a44c44 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85392025-07-01T00:22:54.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ac6613ac-8d23-4b2c-aaca-55efb7a44c44 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85402025-07-01T00:22:54.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ac6613ac-8d23-4b2c-aaca-55efb7a44c44 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85412025-07-01T00:22:54.568ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c4b01e29-79a2-42c2-a751-f60bcde44d21", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
85422025-07-01T00:22:54.568ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
85432025-07-01T00:22:54.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85442025-07-01T00:22:54.574ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "795725d1-b725-4546-9d9d-194d7d6a1c7a", "content-length": "682", "date": "Tue, 01 Jul 2025 00:22:54 GMT"} })
85452025-07-01T00:22:54.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85462025-07-01T00:22:54.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85472025-07-01T00:22:54.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85482025-07-01T00:22:54.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85492025-07-01T00:22:54.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85502025-07-01T00:22:54.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85512025-07-01T00:22:54.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85522025-07-01T00:22:54.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85532025-07-01T00:22:54.592ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.73289ms iteration = 24 status = {}
85542025-07-01T00:22:54.925ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3847 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = b0903221-101d-4ac1-a8d5-e32298797841 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
85552025-07-01T00:22:55.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c2b12a8-35b7-47ec-8024-24205544ccf6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85562025-07-01T00:22:55.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c2b12a8-35b7-47ec-8024-24205544ccf6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85572025-07-01T00:22:55.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3c2b12a8-35b7-47ec-8024-24205544ccf6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85582025-07-01T00:22:56.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = deae84f7-fde3-4889-95ad-a64de70f0d56 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85592025-07-01T00:22:56.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = deae84f7-fde3-4889-95ad-a64de70f0d56 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85602025-07-01T00:22:56.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = deae84f7-fde3-4889-95ad-a64de70f0d56 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85612025-07-01T00:22:57.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4b4c9745-6523-4280-888b-38265f4089e0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85622025-07-01T00:22:57.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4b4c9745-6523-4280-888b-38265f4089e0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85632025-07-01T00:22:57.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4b4c9745-6523-4280-888b-38265f4089e0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85642025-07-01T00:22:58.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fc3bc5e1-100c-4018-98ef-9b8b542d0c9a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85652025-07-01T00:22:58.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fc3bc5e1-100c-4018-98ef-9b8b542d0c9a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85662025-07-01T00:22:58.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fc3bc5e1-100c-4018-98ef-9b8b542d0c9a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85672025-07-01T00:22:59.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1b6baf50-7f7e-4381-97ad-9dd6aebde22f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85682025-07-01T00:22:59.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1b6baf50-7f7e-4381-97ad-9dd6aebde22f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85692025-07-01T00:22:59.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1b6baf50-7f7e-4381-97ad-9dd6aebde22f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85702025-07-01T00:23:00.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ea9f651-8179-4c9b-8594-9d21ab0f13d1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85712025-07-01T00:23:00.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ea9f651-8179-4c9b-8594-9d21ab0f13d1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85722025-07-01T00:23:00.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ea9f651-8179-4c9b-8594-9d21ab0f13d1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85732025-07-01T00:23:01.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27278c1c-27fd-4c89-9473-5df71c67cfe3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85742025-07-01T00:23:01.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27278c1c-27fd-4c89-9473-5df71c67cfe3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85752025-07-01T00:23:01.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 27278c1c-27fd-4c89-9473-5df71c67cfe3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85762025-07-01T00:23:02.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ac5a52f-ce7b-4801-8b1c-1613ab8cda1a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85772025-07-01T00:23:02.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ac5a52f-ce7b-4801-8b1c-1613ab8cda1a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85782025-07-01T00:23:02.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2ac5a52f-ce7b-4801-8b1c-1613ab8cda1a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85792025-07-01T00:23:03.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e8fc8a14-092e-4f37-aba2-1b19c8237b7e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85802025-07-01T00:23:03.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e8fc8a14-092e-4f37-aba2-1b19c8237b7e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85812025-07-01T00:23:03.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e8fc8a14-092e-4f37-aba2-1b19c8237b7e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
85822025-07-01T00:23:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
85832025-07-01T00:23:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
85842025-07-01T00:23:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85852025-07-01T00:23:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85862025-07-01T00:23:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85872025-07-01T00:23:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85882025-07-01T00:23:03.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85892025-07-01T00:23:03.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85902025-07-01T00:23:03.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85912025-07-01T00:23:03.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.543047ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85922025-07-01T00:23:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85932025-07-01T00:23:03.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85942025-07-01T00:23:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85952025-07-01T00:23:03.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85962025-07-01T00:23:03.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85972025-07-01T00:23:03.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85982025-07-01T00:23:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
85992025-07-01T00:23:03.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86002025-07-01T00:23:03.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86012025-07-01T00:23:03.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
86022025-07-01T00:23:03.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.447884ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
86032025-07-01T00:23:04.187ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ff5034e-7296-4cb2-9fe1-da8548e542c2 uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-07-01T00:23:04.187434126Z }
86042025-07-01T00:23:04.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ff5034e-7296-4cb2-9fe1-da8548e542c2 roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86052025-07-01T00:23:04.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ff5034e-7296-4cb2-9fe1-da8548e542c2 resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86062025-07-01T00:23:04.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 66822 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 1ff5034e-7296-4cb2-9fe1-da8548e542c2 response_code = 204 uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86072025-07-01T00:23:04.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6e82533c-b890-43be-94e3-5e057d11bb5e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86082025-07-01T00:23:04.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6e82533c-b890-43be-94e3-5e057d11bb5e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86092025-07-01T00:23:04.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6e82533c-b890-43be-94e3-5e057d11bb5e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86102025-07-01T00:23:04.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 15c4362d-5a0c-4e85-b8b0-f44bdd5f33c0 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
86112025-07-01T00:23:04.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 15c4362d-5a0c-4e85-b8b0-f44bdd5f33c0 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
86122025-07-01T00:23:04.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3031 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = 15c4362d-5a0c-4e85-b8b0-f44bdd5f33c0 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
86132025-07-01T00:23:04.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = c6cb85d3-3872-4f18-86f0-d65dbcb11392 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
86142025-07-01T00:23:04.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = c6cb85d3-3872-4f18-86f0-d65dbcb11392 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
86152025-07-01T00:23:04.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2464 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37066 req_id = c6cb85d3-3872-4f18-86f0-d65dbcb11392 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
86162025-07-01T00:23:04.921ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 549 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 155a6561-609f-4b5c-a303-b289251b338a response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86172025-07-01T00:23:05.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef87b41b-4aa6-472e-98dd-1c0e5a1bb3dd roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86182025-07-01T00:23:05.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef87b41b-4aa6-472e-98dd-1c0e5a1bb3dd resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86192025-07-01T00:23:05.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1998 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ef87b41b-4aa6-472e-98dd-1c0e5a1bb3dd response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86202025-07-01T00:23:06.649ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-07-01T00:23:04.254997695Z }
86212025-07-01T00:23:06.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86222025-07-01T00:23:06.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86232025-07-01T00:23:06.680ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_needs_update = true
86242025-07-01T00:23:06.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86252025-07-01T00:23:06.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86262025-07-01T00:23:06.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86272025-07-01T00:23:06.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86282025-07-01T00:23:06.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86292025-07-01T00:23:06.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86302025-07-01T00:23:06.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86312025-07-01T00:23:06.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86322025-07-01T00:23:06.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86332025-07-01T00:23:06.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86342025-07-01T00:23:06.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86352025-07-01T00:23:06.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Database result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86362025-07-01T00:23:06.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86372025-07-01T00:23:06.704ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: c2846601-f6c6-4baf-a7a2-185cf6c84399, lookup_type: ById(c2846601-f6c6-4baf-a7a2-185cf6c84399) }, key: f118f7c6-85cf-42ee-b1cd-c5a7ae499660, lookup_type: ById(f118f7c6-85cf-42ee-b1cd-c5a7ae499660) }, key: cef5522f-2aad-4527-b06d-fca4b19b8ade, lookup_type: ById(cef5522f-2aad-4527-b06d-fca4b19b8ade) } result = Ok(()) uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86382025-07-01T00:23:06.714ZINFOnexus (dropshot_internal): starting update saga for cef5522f-2aad-4527-b06d-fca4b19b8ade actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-07-01T00:23:04.254997695Z }
86392025-07-01T00:23:06.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 69868 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb response_code = 204 uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86402025-07-01T00:23:06.722ZDEBGnexus (dropshot_internal): preparing instance-update saga for cef5522f-2aad-4527-b06d-fca4b19b8ade... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 0b789385-5112-487d-ae03-33fd13b722eb uri = /vmms/cc5a3736-e42c-4397-9487-05e4538b9f0b
86412025-07-01T00:23:06.722ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update
86422025-07-01T00:23:06.722ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"cef5522f-2aad-4527-b06d-fca4b19b8ade","lookup_type":{"ById":"cef5522f-2aad-4527-b06d-fca4b19b8ade"},"parent":{"key":"f118f7c6-85cf-42ee-b1cd-c5a7ae499660","lookup_type":{"ById":"f118f7c6-85cf-42ee-b1cd-c5a7ae499660"},"parent":{"key":"c2846601-f6c6-4baf-a7a2-185cf6c84399","lookup_type":{"ById":"c2846601-f6c6-4baf-a7a2-185cf6c84399"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86432025-07-01T00:23:06.722ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update
86442025-07-01T00:23:06.778ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update
86452025-07-01T00:23:06.778ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86462025-07-01T00:23:06.778ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86472025-07-01T00:23:06.778ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86482025-07-01T00:23:06.794ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86492025-07-01T00:23:06.794ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86502025-07-01T00:23:06.800ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86512025-07-01T00:23:06.800ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86522025-07-01T00:23:06.815ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86532025-07-01T00:23:06.815ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a81286a4-ec6f-475a-ba66-a382c73adbd3")) node_id = 0 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86542025-07-01T00:23:06.822ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86552025-07-01T00:23:06.822ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86562025-07-01T00:23:06.839ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update
86572025-07-01T00:23:06.839ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86582025-07-01T00:23:06.839ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86592025-07-01T00:23:06.841ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86602025-07-01T00:23:06.842ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86612025-07-01T00:23:06.843ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86622025-07-01T00:23:06.843ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86632025-07-01T00:23:06.845ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86642025-07-01T00:23:06.845ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86652025-07-01T00:23:06.847ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86662025-07-01T00:23:06.847ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86672025-07-01T00:23:06.848ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86682025-07-01T00:23:06.848ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86692025-07-01T00:23:06.850ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86702025-07-01T00:23:06.853ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: c2846601-f6c6-4baf-a7a2-185cf6c84399, lookup_type: ById(c2846601-f6c6-4baf-a7a2-185cf6c84399) }, key: f118f7c6-85cf-42ee-b1cd-c5a7ae499660, lookup_type: ById(f118f7c6-85cf-42ee-b1cd-c5a7ae499660) }, key: cef5522f-2aad-4527-b06d-fca4b19b8ade, lookup_type: ById(cef5522f-2aad-4527-b06d-fca4b19b8ade) } result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86712025-07-01T00:23:06.853ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance updater_id = a81286a4-ec6f-475a-ba66-a382c73adbd3
86722025-07-01T00:23:06.853ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86732025-07-01T00:23:06.853ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86742025-07-01T00:23:06.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = afe927f0-4ad3-4322-9e09-bee1f2109552 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86752025-07-01T00:23:06.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = afe927f0-4ad3-4322-9e09-bee1f2109552 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86762025-07-01T00:23:06.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1574 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = afe927f0-4ad3-4322-9e09-bee1f2109552 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
86772025-07-01T00:23:06.873ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance updater_id = a81286a4-ec6f-475a-ba66-a382c73adbd3
86782025-07-01T00:23:06.873ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86792025-07-01T00:23:06.873ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance
86802025-07-01T00:23:06.880ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade locked_gen = Generation(Generation(2)) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = LockInstance updater_id = a81286a4-ec6f-475a-ba66-a382c73adbd3
86812025-07-01T00:23:06.886ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86822025-07-01T00:23:06.886ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("a81286a4-ec6f-475a-ba66-a382c73adbd3")}) node_id = 1 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86832025-07-01T00:23:06.895ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86842025-07-01T00:23:06.895ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
86852025-07-01T00:23:06.906ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86862025-07-01T00:23:06.906ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86872025-07-01T00:23:06.908ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86882025-07-01T00:23:06.908ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86892025-07-01T00:23:06.910ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86902025-07-01T00:23:06.910ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86912025-07-01T00:23:06.911ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86922025-07-01T00:23:06.915ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: c2846601-f6c6-4baf-a7a2-185cf6c84399, lookup_type: ById(c2846601-f6c6-4baf-a7a2-185cf6c84399) }, key: f118f7c6-85cf-42ee-b1cd-c5a7ae499660, lookup_type: ById(f118f7c6-85cf-42ee-b1cd-c5a7ae499660) }, key: cef5522f-2aad-4527-b06d-fca4b19b8ade, lookup_type: ById(cef5522f-2aad-4527-b06d-fca4b19b8ade) } result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86932025-07-01T00:23:06.915ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86942025-07-01T00:23:06.915ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
86952025-07-01T00:23:06.928ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: cc5a3736-e42c-4397-9487-05e4538b9f0b, time_created: 2025-07-01T00:22:40.541301Z, time_deleted: None, instance_id: cef5522f-2aad-4527-b06d-fca4b19b8ade, sled_id: 887ec56b-486c-42d4-930b-b7b47cbacc61, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-07-01T00:23:04.254997Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-07-01T00:22:38.086147Z, gen: Generation(Generation(3)), propolis_id: Some(cc5a3736-e42c-4397-9487-05e4538b9f0b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(cc5a3736-e42c-4397-9487-05e4538b9f0b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-07-01T00:23:06.928607212Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
86962025-07-01T00:23:06.933ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
86972025-07-01T00:23:06.933ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"cef5522f-2aad-4527-b06d-fca4b19b8ade","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"cc5a3736-e42c-4397-9487-05e4538b9f0b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"cef5522f-2aad-4527-b06d-fca4b19b8ade","lookup_type":{"ById":"cef5522f-2aad-4527-b06d-fca4b19b8ade"},"parent":{"key":"f118f7c6-85cf-42ee-b1cd-c5a7ae499660","lookup_type":{"ById":"f118f7c6-85cf-42ee-b1cd-c5a7ae499660"},"parent":{"key":"c2846601-f6c6-4baf-a7a2-185cf6c84399","lookup_type":{"ById":"c2846601-f6c6-4baf-a7a2-185cf6c84399"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"a81286a4-ec6f-475a-ba66-a382c73adbd3"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"f118f7c6-85cf-42ee-b1cd-c5a7ae499660","ram_diff":1073741824},"destroy_active_vmm":"cc5a3736-e42c-4397-9487-05e4538b9f0b","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-07-01T00:23:06.928607212Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
86982025-07-01T00:23:06.933ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
86992025-07-01T00:23:06.975ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87002025-07-01T00:23:06.975ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87012025-07-01T00:23:06.975ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87022025-07-01T00:23:06.975ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87032025-07-01T00:23:06.989ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87042025-07-01T00:23:06.989ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87052025-07-01T00:23:06.997ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87062025-07-01T00:23:06.997ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87072025-07-01T00:23:07.002ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87082025-07-01T00:23:07.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f1aebade-4d48-4a83-b811-50fc00fc3561")) node_id = 0 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87092025-07-01T00:23:07.009ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87102025-07-01T00:23:07.009ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87112025-07-01T00:23:07.026ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade parent_lock = UpdaterLock { updater_id: a81286a4-ec6f-475a-ba66-a382c73adbd3, locked_gen: Generation(Generation(2)) } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87122025-07-01T00:23:07.026ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = BecomeUpdater
87132025-07-01T00:23:07.026ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = BecomeUpdater
87142025-07-01T00:23:07.050ZDEBGnexus (SagaExecutor): inherited lock from a81286a4-ec6f-475a-ba66-a382c73adbd3 to f1aebade-4d48-4a83-b811-50fc00fc3561 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = a81286a4-ec6f-475a-ba66-a382c73adbd3 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = BecomeUpdater updater_id = f1aebade-4d48-4a83-b811-50fc00fc3561
87152025-07-01T00:23:07.050ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87162025-07-01T00:23:07.050ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87172025-07-01T00:23:07.050ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f1aebade-4d48-4a83-b811-50fc00fc3561")}) node_id = 1 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87182025-07-01T00:23:07.057ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87192025-07-01T00:23:07.057ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87202025-07-01T00:23:07.061ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87212025-07-01T00:23:07.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87222025-07-01T00:23:07.072ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87232025-07-01T00:23:07.072ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87242025-07-01T00:23:07.079ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87252025-07-01T00:23:07.079ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade
87262025-07-01T00:23:07.086ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UpdateNetworkConfig
87272025-07-01T00:23:07.086ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UpdateNetworkConfig
87282025-07-01T00:23:07.093ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UpdateNetworkConfig
87292025-07-01T00:23:07.093ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UpdateNetworkConfig
87302025-07-01T00:23:07.097ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
87312025-07-01T00:23:07.097ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UpdateNetworkConfig
87322025-07-01T00:23:07.097ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UpdateNetworkConfig
87332025-07-01T00:23:07.099ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
87342025-07-01T00:23:07.100ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
87352025-07-01T00:23:07.100ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
87362025-07-01T00:23:07.101ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
87372025-07-01T00:23:07.102ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
87382025-07-01T00:23:07.102ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
87392025-07-01T00:23:07.102ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
87402025-07-01T00:23:07.107ZDEBGnexus: notifying dendrite of updates instance_id = Some(cef5522f-2aad-4527-b06d-fca4b19b8ade (instance)) switch = switch0
87412025-07-01T00:23:07.111ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1716, tv_nsec: 936696821 } })
87422025-07-01T00:23:07.111ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1193
87432025-07-01T00:23:07.143ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
87442025-07-01T00:23:07.143ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87452025-07-01T00:23:07.143ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1510719-4d8e-473a-975a-12b1e538d22f", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:07 GMT"} })
87462025-07-01T00:23:07.143ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87472025-07-01T00:23:07.144ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87482025-07-01T00:23:07.175ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87492025-07-01T00:23:07.175ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87502025-07-01T00:23:07.193ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87512025-07-01T00:23:07.193ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87522025-07-01T00:23:07.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
87532025-07-01T00:23:07.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
87542025-07-01T00:23:07.261ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-07-01T00:23:07.229469Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, time_modified: Some(2025-07-01T00:23:07.229469Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f118f7c6-85cf-42ee-b1cd-c5a7ae499660, time_modified: Some(2025-07-01T00:23:07.229469Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87552025-07-01T00:23:07.261ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87562025-07-01T00:23:07.261ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87572025-07-01T00:23:07.267ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87582025-07-01T00:23:07.267ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87592025-07-01T00:23:07.288ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87602025-07-01T00:23:07.288ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UnassignOximeterProducer
87612025-07-01T00:23:07.288ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UnassignOximeterProducer
87622025-07-01T00:23:07.301ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = a8a4439d-9bed-4df3-9921-c50bfb72fc42 producer_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87632025-07-01T00:23:07.301ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UnassignOximeterProducer
87642025-07-01T00:23:07.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = UnassignOximeterProducer
87652025-07-01T00:23:07.345ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87662025-07-01T00:23:07.345ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/cef5522f-2aad-4527-b06d-fca4b19b8ade
87672025-07-01T00:23:07.362ZDEBGnexus (SagaExecutor): client response oximeter-collector = cef5522f-2aad-4527-b06d-fca4b19b8ade result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/cef5522f-2aad-4527-b06d-fca4b19b8ade", status: 204, headers: {"x-request-id": "c266ffcf-8abf-4606-be14-46a60ac7def0", "date": "Tue, 01 Jul 2025 00:23:07 GMT"} }) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87682025-07-01T00:23:07.362ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = a8a4439d-9bed-4df3-9921-c50bfb72fc42 producer_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87692025-07-01T00:23:07.364ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87702025-07-01T00:23:07.364ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87712025-07-01T00:23:07.372ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87722025-07-01T00:23:07.372ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87732025-07-01T00:23:07.382ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade lock = UpdaterLock { updater_id: f1aebade-4d48-4a83-b811-50fc00fc3561, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-07-01T00:23:06.928607212Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87742025-07-01T00:23:07.382ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = CommitInstanceUpdates
87752025-07-01T00:23:07.382ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = CommitInstanceUpdates
87762025-07-01T00:23:07.404ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade new_runtime = InstanceRuntimeState { time_updated: 2025-07-01T00:23:06.928607212Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
87772025-07-01T00:23:07.404ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
87782025-07-01T00:23:07.404ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
87792025-07-01T00:23:07.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87802025-07-01T00:23:07.404ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87812025-07-01T00:23:07.404ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87822025-07-01T00:23:07.404ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87832025-07-01T00:23:07.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87842025-07-01T00:23:07.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87852025-07-01T00:23:07.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87862025-07-01T00:23:07.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87872025-07-01T00:23:07.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87882025-07-01T00:23:07.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87892025-07-01T00:23:07.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87902025-07-01T00:23:07.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87912025-07-01T00:23:07.410ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87922025-07-01T00:23:07.410ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87932025-07-01T00:23:07.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87942025-07-01T00:23:07.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87952025-07-01T00:23:07.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87962025-07-01T00:23:07.421ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87972025-07-01T00:23:07.421ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("cef5522f-2aad-4527-b06d-fca4b19b8ade"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cc5a3736-e42c-4397-9487-05e4538b9f0b")}) node_id = 7 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
87982025-07-01T00:23:07.437ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
87992025-07-01T00:23:07.437ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88002025-07-01T00:23:07.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88012025-07-01T00:23:07.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88022025-07-01T00:23:07.454ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88032025-07-01T00:23:07.454ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88042025-07-01T00:23:07.458ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88052025-07-01T00:23:07.458ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88062025-07-01T00:23:07.462ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
88072025-07-01T00:23:07.462ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ReleaseSledResources
88082025-07-01T00:23:07.462ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ReleaseSledResources
88092025-07-01T00:23:07.493ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88102025-07-01T00:23:07.493ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88112025-07-01T00:23:07.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88122025-07-01T00:23:07.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88132025-07-01T00:23:07.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88142025-07-01T00:23:07.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88152025-07-01T00:23:07.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88162025-07-01T00:23:07.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88172025-07-01T00:23:07.498ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88182025-07-01T00:23:07.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88192025-07-01T00:23:07.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88202025-07-01T00:23:07.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88212025-07-01T00:23:07.505ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88222025-07-01T00:23:07.505ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88232025-07-01T00:23:07.509ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade propolis_id = cc5a3736-e42c-4397-9487-05e4538b9f0b saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
88242025-07-01T00:23:07.509ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = MarkVmmDeleted
88252025-07-01T00:23:07.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = MarkVmmDeleted
88262025-07-01T00:23:07.520ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88272025-07-01T00:23:07.520ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88282025-07-01T00:23:07.520ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3394b6f5-83c3-4322-b146-3d495293717f", "content-length": "372", "date": "Tue, 01 Jul 2025 00:23:07 GMT"} })
88292025-07-01T00:23:07.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88302025-07-01T00:23:07.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88312025-07-01T00:23:07.526ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88322025-07-01T00:23:07.526ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88332025-07-01T00:23:07.536ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88342025-07-01T00:23:07.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88352025-07-01T00:23:07.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88362025-07-01T00:23:07.536ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c8a7b82-babf-43d6-9b11-af1265ee8a8f", "content-length": "691", "date": "Tue, 01 Jul 2025 00:23:07 GMT"} })
88372025-07-01T00:23:07.536ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
88382025-07-01T00:23:07.536ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
88392025-07-01T00:23:07.536ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
88402025-07-01T00:23:07.537ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
88412025-07-01T00:23:07.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
88422025-07-01T00:23:07.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2ae9da46-9238-49c6-bf1c-5cb1b7f41ee7", "date": "Tue, 01 Jul 2025 00:23:07 GMT"} })
88432025-07-01T00:23:07.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88442025-07-01T00:23:07.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88452025-07-01T00:23:07.539ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 134.386817ms iteration = 25 status = {}
88462025-07-01T00:23:07.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88472025-07-01T00:23:07.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88482025-07-01T00:23:07.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88492025-07-01T00:23:07.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88502025-07-01T00:23:07.545ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88512025-07-01T00:23:07.545ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88522025-07-01T00:23:07.545ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c4d1ea90-9e37-4902-98f0-8edcfdea93c0", "date": "Tue, 01 Jul 2025 00:23:07 GMT"} })
88532025-07-01T00:23:07.546ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 141.767909ms iteration = 25 status = {}
88542025-07-01T00:23:07.549ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88552025-07-01T00:23:07.549ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88562025-07-01T00:23:07.563ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88572025-07-01T00:23:07.563ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88582025-07-01T00:23:07.574ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88592025-07-01T00:23:07.575ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88602025-07-01T00:23:07.576ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88612025-07-01T00:23:07.576ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88622025-07-01T00:23:07.577ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88632025-07-01T00:23:07.577ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88642025-07-01T00:23:07.578ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88652025-07-01T00:23:07.582ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: c2846601-f6c6-4baf-a7a2-185cf6c84399, lookup_type: ById(c2846601-f6c6-4baf-a7a2-185cf6c84399) }, key: f118f7c6-85cf-42ee-b1cd-c5a7ae499660, lookup_type: ById(f118f7c6-85cf-42ee-b1cd-c5a7ae499660) }, key: cef5522f-2aad-4527-b06d-fca4b19b8ade, lookup_type: ById(cef5522f-2aad-4527-b06d-fca4b19b8ade) } result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88662025-07-01T00:23:07.582ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88672025-07-01T00:23:07.582ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_node = ChainSuccessorSaga
88682025-07-01T00:23:07.588ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1351 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update
88692025-07-01T00:23:07.588ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Signaled
88702025-07-01T00:23:07.588ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88712025-07-01T00:23:07.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88722025-07-01T00:23:07.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88732025-07-01T00:23:07.590ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88742025-07-01T00:23:07.590ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88752025-07-01T00:23:07.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88762025-07-01T00:23:07.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88772025-07-01T00:23:07.590ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88782025-07-01T00:23:07.591ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88792025-07-01T00:23:07.593ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88802025-07-01T00:23:07.593ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88812025-07-01T00:23:07.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88822025-07-01T00:23:07.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88832025-07-01T00:23:07.601ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88842025-07-01T00:23:07.601ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88852025-07-01T00:23:07.612ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88862025-07-01T00:23:07.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88872025-07-01T00:23:07.615ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88882025-07-01T00:23:07.615ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6
88892025-07-01T00:23:07.628ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88902025-07-01T00:23:07.628ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88912025-07-01T00:23:07.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 40.659532ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88922025-07-01T00:23:07.677ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88932025-07-01T00:23:07.695ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 saga_name = instance-update saga_result = SagaResult { saga_id: e0f369b5-1e67-40b8-b319-ed863984f7f6, saga_log: SagaLog { saga_id: e0f369b5-1e67-40b8-b319-ed863984f7f6, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("f1aebade-4d48-4a83-b811-50fc00fc3561")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f1aebade-4d48-4a83-b811-50fc00fc3561")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("cef5522f-2aad-4527-b06d-fca4b19b8ade"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cc5a3736-e42c-4397-9487-05e4538b9f0b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("cef5522f-2aad-4527-b06d-fca4b19b8ade"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cc5a3736-e42c-4397-9487-05e4538b9f0b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("f1aebade-4d48-4a83-b811-50fc00fc3561"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("f1aebade-4d48-4a83-b811-50fc00fc3561")}} }) }
88942025-07-01T00:23:07.695ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e0f369b5-1e67-40b8-b319-ed863984f7f6 instance_id = cef5522f-2aad-4527-b06d-fca4b19b8ade saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update
88952025-07-01T00:23:07.695ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88962025-07-01T00:23:07.695ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
88972025-07-01T00:23:07.736ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
88982025-07-01T00:23:07.736ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
88992025-07-01T00:23:07.746ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
89002025-07-01T00:23:07.746ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
89012025-07-01T00:23:07.755ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
89022025-07-01T00:23:07.755ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af
89032025-07-01T00:23:07.803ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update sec_id = 8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
89042025-07-01T00:23:07.803ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af saga_name = start-instance-update saga_result = SagaResult { saga_id: 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af, saga_log: SagaLog { saga_id: 0b322f82-2bdc-42c4-a3a5-1f1c5626d5af, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("a81286a4-ec6f-475a-ba66-a382c73adbd3")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("a81286a4-ec6f-475a-ba66-a382c73adbd3")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("a81286a4-ec6f-475a-ba66-a382c73adbd3"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("a81286a4-ec6f-475a-ba66-a382c73adbd3")}} }) }
89052025-07-01T00:23:07.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 726eaf90-f9a3-4d9c-a9b5-e4ed7c2be427 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89062025-07-01T00:23:07.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 726eaf90-f9a3-4d9c-a9b5-e4ed7c2be427 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89072025-07-01T00:23:07.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 726eaf90-f9a3-4d9c-a9b5-e4ed7c2be427 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89082025-07-01T00:23:08.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fbd48430-bcdc-4199-adf8-48a6a7fc8ff4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89092025-07-01T00:23:08.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fbd48430-bcdc-4199-adf8-48a6a7fc8ff4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89102025-07-01T00:23:08.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = fbd48430-bcdc-4199-adf8-48a6a7fc8ff4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89112025-07-01T00:23:09.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 404a5f2f-6921-406b-8b91-686ccbccd3a1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89122025-07-01T00:23:09.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 404a5f2f-6921-406b-8b91-686ccbccd3a1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89132025-07-01T00:23:09.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 404a5f2f-6921-406b-8b91-686ccbccd3a1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89142025-07-01T00:23:10.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bbaa0624-ba8d-4a2d-b7ac-b9e50ebf7e70 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89152025-07-01T00:23:10.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bbaa0624-ba8d-4a2d-b7ac-b9e50ebf7e70 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89162025-07-01T00:23:10.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bbaa0624-ba8d-4a2d-b7ac-b9e50ebf7e70 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89172025-07-01T00:23:11.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 15989af9-7a5c-42df-9fe0-3a0d9b498d18 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89182025-07-01T00:23:11.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 15989af9-7a5c-42df-9fe0-3a0d9b498d18 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89192025-07-01T00:23:11.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 15989af9-7a5c-42df-9fe0-3a0d9b498d18 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89202025-07-01T00:23:12.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6d078d60-efa4-4995-946a-7395ffc7c874 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89212025-07-01T00:23:12.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6d078d60-efa4-4995-946a-7395ffc7c874 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89222025-07-01T00:23:12.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6d078d60-efa4-4995-946a-7395ffc7c874 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89232025-07-01T00:23:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
89242025-07-01T00:23:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
89252025-07-01T00:23:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89262025-07-01T00:23:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89272025-07-01T00:23:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89282025-07-01T00:23:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89292025-07-01T00:23:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89302025-07-01T00:23:13.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89312025-07-01T00:23:13.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89322025-07-01T00:23:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.230016ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89332025-07-01T00:23:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89342025-07-01T00:23:13.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89352025-07-01T00:23:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89362025-07-01T00:23:13.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89372025-07-01T00:23:13.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89382025-07-01T00:23:13.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89392025-07-01T00:23:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
89402025-07-01T00:23:13.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89412025-07-01T00:23:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89422025-07-01T00:23:13.924ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
89432025-07-01T00:23:13.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.246281ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
89442025-07-01T00:23:13.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 30ec3bf3-8c39-4023-a360-e13aa003fbc3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89452025-07-01T00:23:13.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 30ec3bf3-8c39-4023-a360-e13aa003fbc3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89462025-07-01T00:23:13.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1635 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 30ec3bf3-8c39-4023-a360-e13aa003fbc3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89472025-07-01T00:23:14.923ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 802 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 593e613d-f6f2-49f0-af4e-c6780af99892 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
89482025-07-01T00:23:14.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8084a440-463e-4cdc-8cb5-e3156a0fcbb6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89492025-07-01T00:23:14.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8084a440-463e-4cdc-8cb5-e3156a0fcbb6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89502025-07-01T00:23:14.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8084a440-463e-4cdc-8cb5-e3156a0fcbb6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89512025-07-01T00:23:15.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e4a387cb-5bbf-401c-b7e8-696b508bf45a roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89522025-07-01T00:23:16.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e4a387cb-5bbf-401c-b7e8-696b508bf45a resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89532025-07-01T00:23:16.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e4a387cb-5bbf-401c-b7e8-696b508bf45a response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89542025-07-01T00:23:17.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ac417694-444a-4370-adb9-6fd2618a8df0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89552025-07-01T00:23:17.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ac417694-444a-4370-adb9-6fd2618a8df0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89562025-07-01T00:23:17.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ac417694-444a-4370-adb9-6fd2618a8df0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89572025-07-01T00:23:18.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = aed8aaf7-417d-49e7-b6e9-28e441018418 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89582025-07-01T00:23:18.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = aed8aaf7-417d-49e7-b6e9-28e441018418 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89592025-07-01T00:23:18.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = aed8aaf7-417d-49e7-b6e9-28e441018418 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89602025-07-01T00:23:19.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ae862f5-f184-455b-ae33-bf37ac501f9b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89612025-07-01T00:23:19.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ae862f5-f184-455b-ae33-bf37ac501f9b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89622025-07-01T00:23:19.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8ae862f5-f184-455b-ae33-bf37ac501f9b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89632025-07-01T00:23:20.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 85244155-f9ab-4c6c-b04c-abab387ec8ed roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89642025-07-01T00:23:20.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 85244155-f9ab-4c6c-b04c-abab387ec8ed resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89652025-07-01T00:23:20.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3141 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 85244155-f9ab-4c6c-b04c-abab387ec8ed response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89662025-07-01T00:23:21.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a291e80-1247-486d-a989-487ffc6d29ae roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89672025-07-01T00:23:21.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a291e80-1247-486d-a989-487ffc6d29ae resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89682025-07-01T00:23:21.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a291e80-1247-486d-a989-487ffc6d29ae response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89692025-07-01T00:23:22.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 080a7640-cdce-444e-b1b0-d82048896409 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89702025-07-01T00:23:22.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 080a7640-cdce-444e-b1b0-d82048896409 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89712025-07-01T00:23:22.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 080a7640-cdce-444e-b1b0-d82048896409 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89722025-07-01T00:23:23.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a025d662-2c79-4e83-a272-1066654c3011 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89732025-07-01T00:23:23.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a025d662-2c79-4e83-a272-1066654c3011 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89742025-07-01T00:23:23.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a025d662-2c79-4e83-a272-1066654c3011 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
89752025-07-01T00:23:23.901ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
89762025-07-01T00:23:23.901ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
89772025-07-01T00:23:23.902ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
89782025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.88\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
89792025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
89802025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89812025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
89822025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89832025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
89842025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
89852025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89862025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
89872025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
89882025-07-01T00:23:23.902ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:13:23.902052650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89892025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
89902025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89912025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89922025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89932025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
89942025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
89952025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89962025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89972025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
89982025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89992025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90002025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90012025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90022025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90032025-07-01T00:23:23.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90042025-07-01T00:23:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 727187881 } })
90052025-07-01T00:23:23.902ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 727195212 } })
90062025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
90072025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.023008ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
90082025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
90092025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.104271ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
90102025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
90112025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
90122025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
90132025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90142025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
90152025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90162025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90172025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90182025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
90192025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90202025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
90212025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
90222025-07-01T00:23:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90232025-07-01T00:23:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
90242025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90252025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
90262025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
90272025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90282025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90292025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
90302025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90312025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
90322025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90332025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
90342025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90352025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
90362025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
90372025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90382025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
90392025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
90402025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 17 reason = Timeout
90412025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
90422025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 7.48\u{b5}s iteration = 17 status = "Disabled"
90432025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
90442025-07-01T00:23:23.904ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
90452025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90462025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90472025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90482025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90492025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90502025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90512025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90522025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90532025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90542025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90552025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90562025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90572025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90582025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90592025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90602025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90612025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90622025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90632025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90642025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90652025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90662025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90672025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90682025-07-01T00:23:23.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90692025-07-01T00:23:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90702025-07-01T00:23:23.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 730063250 } })
90712025-07-01T00:23:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90722025-07-01T00:23:23.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90732025-07-01T00:23:23.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
90742025-07-01T00:23:23.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 730411249 } })
90752025-07-01T00:23:23.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.928857ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90762025-07-01T00:23:23.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90772025-07-01T00:23:23.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:13:23.902052650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
90782025-07-01T00:23:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.063181ms iteration = 13 status = {"expiration":"2025-07-01T00:13:23.902052650Z","pruned":[]}
90792025-07-01T00:23:23.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
90802025-07-01T00:23:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90812025-07-01T00:23:23.907ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90822025-07-01T00:23:23.907ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90832025-07-01T00:23:23.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90842025-07-01T00:23:23.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90852025-07-01T00:23:23.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90862025-07-01T00:23:23.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90872025-07-01T00:23:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90882025-07-01T00:23:23.909ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90892025-07-01T00:23:23.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90902025-07-01T00:23:23.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90912025-07-01T00:23:23.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90922025-07-01T00:23:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90932025-07-01T00:23:23.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90942025-07-01T00:23:23.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90952025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90962025-07-01T00:23:23.911ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90972025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90982025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90992025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91002025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91012025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91022025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91032025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91042025-07-01T00:23:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91052025-07-01T00:23:23.912ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91062025-07-01T00:23:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91072025-07-01T00:23:23.912ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91082025-07-01T00:23:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91092025-07-01T00:23:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
91102025-07-01T00:23:23.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91112025-07-01T00:23:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91122025-07-01T00:23:23.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91132025-07-01T00:23:23.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91142025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91152025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
91162025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
91172025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
91182025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91192025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
91202025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
91212025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
91222025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
91232025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
91242025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91252025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
91262025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
91272025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
91282025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
91292025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
91302025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91312025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
91322025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
91332025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91342025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
91352025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
91362025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
91372025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
91382025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91392025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
91402025-07-01T00:23:23.914ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91412025-07-01T00:23:23.915ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 739525669 } })
91422025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
91432025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91442025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91452025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91462025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91472025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91482025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91492025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91502025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91512025-07-01T00:23:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91522025-07-01T00:23:23.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.204601ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91532025-07-01T00:23:23.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91542025-07-01T00:23:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91552025-07-01T00:23:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91562025-07-01T00:23:23.918ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91572025-07-01T00:23:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91582025-07-01T00:23:23.918ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91592025-07-01T00:23:23.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91602025-07-01T00:23:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91612025-07-01T00:23:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91622025-07-01T00:23:23.920ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1733, tv_nsec: 744571887 } })
91632025-07-01T00:23:23.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91642025-07-01T00:23:23.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
91652025-07-01T00:23:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91662025-07-01T00:23:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91672025-07-01T00:23:23.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91682025-07-01T00:23:23.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91692025-07-01T00:23:23.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91702025-07-01T00:23:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
91712025-07-01T00:23:23.925ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
91722025-07-01T00:23:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
91732025-07-01T00:23:23.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91742025-07-01T00:23:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91752025-07-01T00:23:23.931ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
91762025-07-01T00:23:23.931ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 17.18368ms iteration = 13 status = {"by_rx":{},"error":null}
91772025-07-01T00:23:23.932ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.621612ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
91782025-07-01T00:23:23.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.061342ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
91792025-07-01T00:23:23.933ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91802025-07-01T00:23:23.933ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.681252ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
91812025-07-01T00:23:23.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91822025-07-01T00:23:23.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91832025-07-01T00:23:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91842025-07-01T00:23:23.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91852025-07-01T00:23:23.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 32.514819ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91862025-07-01T00:23:23.936ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 22.240998ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
91872025-07-01T00:23:23.938ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91882025-07-01T00:23:23.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91892025-07-01T00:23:23.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91902025-07-01T00:23:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91912025-07-01T00:23:23.939ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
91922025-07-01T00:23:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
91932025-07-01T00:23:23.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91942025-07-01T00:23:23.941ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 26.937547ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
91952025-07-01T00:23:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
91962025-07-01T00:23:23.942ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91972025-07-01T00:23:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91982025-07-01T00:23:23.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91992025-07-01T00:23:23.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92002025-07-01T00:23:23.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92012025-07-01T00:23:23.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
92022025-07-01T00:23:23.944ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92032025-07-01T00:23:23.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92042025-07-01T00:23:23.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92052025-07-01T00:23:23.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92062025-07-01T00:23:23.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92072025-07-01T00:23:23.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92082025-07-01T00:23:23.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92092025-07-01T00:23:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92102025-07-01T00:23:23.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92112025-07-01T00:23:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92122025-07-01T00:23:23.959ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.911869ms iteration = 28 status = {"physical_disks_added":0}
92132025-07-01T00:23:23.961ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
92142025-07-01T00:23:23.961ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
92152025-07-01T00:23:23.961ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
92162025-07-01T00:23:23.961ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.462993ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
92172025-07-01T00:23:23.961ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.585295ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
92182025-07-01T00:23:23.964ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92192025-07-01T00:23:23.967ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92202025-07-01T00:23:23.967ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92212025-07-01T00:23:23.967ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92222025-07-01T00:23:23.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92232025-07-01T00:23:23.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92242025-07-01T00:23:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92252025-07-01T00:23:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
92262025-07-01T00:23:23.968ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92272025-07-01T00:23:23.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92282025-07-01T00:23:23.970ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92292025-07-01T00:23:23.970ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 66.320794ms iteration = 6 status = {"nsuccess":5}
92302025-07-01T00:23:23.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92312025-07-01T00:23:23.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
92322025-07-01T00:23:23.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92332025-07-01T00:23:23.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92342025-07-01T00:23:23.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92352025-07-01T00:23:23.975ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
92362025-07-01T00:23:23.975ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
92372025-07-01T00:23:23.975ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
92382025-07-01T00:23:23.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92392025-07-01T00:23:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92402025-07-01T00:23:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92412025-07-01T00:23:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92422025-07-01T00:23:23.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92432025-07-01T00:23:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92442025-07-01T00:23:23.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92452025-07-01T00:23:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92462025-07-01T00:23:23.979ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92472025-07-01T00:23:23.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.716018ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92482025-07-01T00:23:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92492025-07-01T00:23:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.608262ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
92502025-07-01T00:23:23.981ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
92512025-07-01T00:23:23.981ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
92522025-07-01T00:23:23.981ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.217533ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
92532025-07-01T00:23:23.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92542025-07-01T00:23:23.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92552025-07-01T00:23:24.007ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
92562025-07-01T00:23:24.008ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 106.045351ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
92572025-07-01T00:23:24.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92582025-07-01T00:23:24.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92592025-07-01T00:23:24.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92602025-07-01T00:23:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92612025-07-01T00:23:24.013ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
92622025-07-01T00:23:24.013ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 110.001479ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
92632025-07-01T00:23:24.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642025-07-01T00:23:24.018ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92652025-07-01T00:23:24.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92662025-07-01T00:23:24.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92672025-07-01T00:23:24.018ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92682025-07-01T00:23:24.018ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
92692025-07-01T00:23:24.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.824871ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
92702025-07-01T00:23:24.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92712025-07-01T00:23:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92722025-07-01T00:23:24.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92732025-07-01T00:23:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92742025-07-01T00:23:24.024ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
92752025-07-01T00:23:24.024ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
92762025-07-01T00:23:24.024ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
92772025-07-01T00:23:24.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92782025-07-01T00:23:24.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92792025-07-01T00:23:24.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92802025-07-01T00:23:24.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92812025-07-01T00:23:24.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822025-07-01T00:23:24.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92832025-07-01T00:23:24.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92842025-07-01T00:23:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92852025-07-01T00:23:24.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92862025-07-01T00:23:24.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92872025-07-01T00:23:24.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92882025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
92892025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
92902025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92912025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92922025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
92932025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92942025-07-01T00:23:24.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92952025-07-01T00:23:24.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92962025-07-01T00:23:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92972025-07-01T00:23:24.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92982025-07-01T00:23:24.034ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 130.581013ms iteration = 25 status = 0
92992025-07-01T00:23:24.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.562288ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93002025-07-01T00:23:24.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93012025-07-01T00:23:24.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93022025-07-01T00:23:24.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93032025-07-01T00:23:24.039ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
93042025-07-01T00:23:24.039ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
93052025-07-01T00:23:24.039ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
93062025-07-01T00:23:24.039ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.467521ms iteration = 13 status = {"generation":1}
93072025-07-01T00:23:24.060ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
93082025-07-01T00:23:24.060ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
93092025-07-01T00:23:24.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93102025-07-01T00:23:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93112025-07-01T00:23:24.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93122025-07-01T00:23:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93132025-07-01T00:23:24.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93142025-07-01T00:23:24.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93152025-07-01T00:23:24.066ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
93162025-07-01T00:23:24.066ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
93172025-07-01T00:23:24.066ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
93182025-07-01T00:23:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 164.193773ms iteration = 13 status = {"generation":2}
93192025-07-01T00:23:24.084ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
93202025-07-01T00:23:24.084ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 180.350114ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
93212025-07-01T00:23:24.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c53acb6e-5a5a-455f-9d69-48df264ca551 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
93222025-07-01T00:23:24.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c53acb6e-5a5a-455f-9d69-48df264ca551 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
93232025-07-01T00:23:24.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c53acb6e-5a5a-455f-9d69-48df264ca551 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
93242025-07-01T00:23:24.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
93252025-07-01T00:23:24.205ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93262025-07-01T00:23:24.205ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb858ede-85cc-497b-a868-74a2d0434e3a", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93272025-07-01T00:23:24.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93282025-07-01T00:23:24.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93292025-07-01T00:23:24.285ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93302025-07-01T00:23:24.285ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93312025-07-01T00:23:24.286ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f08e5e-d4c2-4b49-b09d-18a61a1d6eea", "content-length": "372", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93322025-07-01T00:23:24.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93332025-07-01T00:23:24.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93342025-07-01T00:23:24.299ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93352025-07-01T00:23:24.300ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93362025-07-01T00:23:24.300ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6623f5b3-7e35-461f-9182-8225a29ffbbe", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93372025-07-01T00:23:24.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93382025-07-01T00:23:24.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93392025-07-01T00:23:24.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93402025-07-01T00:23:24.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93412025-07-01T00:23:24.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93422025-07-01T00:23:24.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93432025-07-01T00:23:24.308ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93442025-07-01T00:23:24.308ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93452025-07-01T00:23:24.309ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e437a873-6833-4871-ad5d-727991380fa4", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93462025-07-01T00:23:24.310ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.536102ms iteration = 26 status = {}
93472025-07-01T00:23:24.330ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93482025-07-01T00:23:24.331ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c521449-da5a-4bd9-9e7a-31d4ff005879", "content-length": "691", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93492025-07-01T00:23:24.331ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93502025-07-01T00:23:24.331ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93512025-07-01T00:23:24.331ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93522025-07-01T00:23:24.333ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 429.205312ms iteration = 26 status = {}
93532025-07-01T00:23:24.334ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
93542025-07-01T00:23:24.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
93552025-07-01T00:23:24.338ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93562025-07-01T00:23:24.338ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dcae9c4-3cdd-4ee1-bfcd-78159d8bcdd5", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93572025-07-01T00:23:24.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93582025-07-01T00:23:24.340ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
93592025-07-01T00:23:24.342ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
93602025-07-01T00:23:24.342ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93612025-07-01T00:23:24.342ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b74252bf-6f4b-4728-b277-bc86ac8ad4d2", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93622025-07-01T00:23:24.342ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93632025-07-01T00:23:24.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93642025-07-01T00:23:24.345ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
93652025-07-01T00:23:24.383ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
93662025-07-01T00:23:24.383ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "a372ddff-5bd8-4ebf-881f-db67b18a888e", "content-length": "78", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93672025-07-01T00:23:24.383ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
93682025-07-01T00:23:24.383ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
93692025-07-01T00:23:24.383ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
93702025-07-01T00:23:24.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
93712025-07-01T00:23:24.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
93722025-07-01T00:23:24.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
93732025-07-01T00:23:24.386ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
93742025-07-01T00:23:24.386ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
93752025-07-01T00:23:24.387ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
93762025-07-01T00:23:24.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
93772025-07-01T00:23:24.388ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
93782025-07-01T00:23:24.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
93792025-07-01T00:23:24.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
93802025-07-01T00:23:24.389ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
93812025-07-01T00:23:24.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
93822025-07-01T00:23:24.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
93832025-07-01T00:23:24.390ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
93842025-07-01T00:23:24.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
93852025-07-01T00:23:24.391ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
93862025-07-01T00:23:24.391ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
93872025-07-01T00:23:24.391ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c34fd9f3-4226-4a49-a916-f88531f12474", "content-length": "81", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93882025-07-01T00:23:24.391ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
93892025-07-01T00:23:24.391ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
93902025-07-01T00:23:24.391ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "31674d67-7be5-4a2b-9626-8280c6a0fb5f", "content-length": "81", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93912025-07-01T00:23:24.429ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
93922025-07-01T00:23:24.429ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
93932025-07-01T00:23:24.429ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ec9e5c0-3064-4d8b-b3db-0f829ef2ac71", "content-length": "81", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
93942025-07-01T00:23:24.431ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 517.090727ms iteration = 25 status = {"errors":[],"sps":[]}
93952025-07-01T00:23:24.505ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 603.329906ms iteration = 25 status = {}
93962025-07-01T00:23:24.520ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93972025-07-01T00:23:24.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93982025-07-01T00:23:24.523ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 621.134084ms iteration = 25 status = null
93992025-07-01T00:23:24.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94002025-07-01T00:23:24.610ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "39c072fb-2861-449e-bde7-555a24edc8f6", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94012025-07-01T00:23:24.610ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94022025-07-01T00:23:24.611ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
94032025-07-01T00:23:24.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c329bb06-86ac-4fcb-813f-e1cd78264466", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94042025-07-01T00:23:24.611ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94052025-07-01T00:23:24.613ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94062025-07-01T00:23:24.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 711.994959ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
94072025-07-01T00:23:24.671ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
94082025-07-01T00:23:24.672ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "306552bf-4129-4f30-87c1-3d56eb500041", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94092025-07-01T00:23:24.672ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94102025-07-01T00:23:24.673ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d1d185fb-f8b7-4620-98e6-a66b9d959751", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94112025-07-01T00:23:24.673ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94122025-07-01T00:23:24.675ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6f0c66f3-b503-4ad6-8719-02e350ac3f8e", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94132025-07-01T00:23:24.675ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94142025-07-01T00:23:24.677ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
94152025-07-01T00:23:24.677ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 775.59956ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
94162025-07-01T00:23:24.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94172025-07-01T00:23:24.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94182025-07-01T00:23:24.689ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
94192025-07-01T00:23:24.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94202025-07-01T00:23:24.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94212025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
94222025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
94232025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94242025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94252025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94262025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94272025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94282025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94292025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94302025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94312025-07-01T00:23:24.702ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
94322025-07-01T00:23:24.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94332025-07-01T00:23:24.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94342025-07-01T00:23:24.705ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
94352025-07-01T00:23:24.705ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94362025-07-01T00:23:24.908ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4c88def5-50eb-4d8e-96ba-97e053f71d2d", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
94372025-07-01T00:23:24.908ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
94382025-07-01T00:23:24.908ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94392025-07-01T00:23:24.909ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff573361-6ddb-468f-89b4-aa76209ff27f", "content-length": "682", "date": "Tue, 01 Jul 2025 00:23:24 GMT"} })
94402025-07-01T00:23:24.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94412025-07-01T00:23:24.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94422025-07-01T00:23:24.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94432025-07-01T00:23:24.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94442025-07-01T00:23:24.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94452025-07-01T00:23:24.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94462025-07-01T00:23:24.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94472025-07-01T00:23:24.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94482025-07-01T00:23:24.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 512 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 3cb9ba4a-0aa8-43c9-aa77-2e46608c9d02 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
94492025-07-01T00:23:24.926ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.02271539s iteration = 25 status = {}
94502025-07-01T00:23:25.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c8249cfe-92ff-4c9d-9bc9-6a1d67eb8a33 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94512025-07-01T00:23:25.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c8249cfe-92ff-4c9d-9bc9-6a1d67eb8a33 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94522025-07-01T00:23:25.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c8249cfe-92ff-4c9d-9bc9-6a1d67eb8a33 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94532025-07-01T00:23:26.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 43b98654-e09b-4737-a311-fb45108c1f04 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94542025-07-01T00:23:26.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 43b98654-e09b-4737-a311-fb45108c1f04 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94552025-07-01T00:23:26.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 43b98654-e09b-4737-a311-fb45108c1f04 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94562025-07-01T00:23:27.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 754ece6b-50a3-4507-b35e-45df2348120f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94572025-07-01T00:23:27.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 754ece6b-50a3-4507-b35e-45df2348120f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94582025-07-01T00:23:27.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2837 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 754ece6b-50a3-4507-b35e-45df2348120f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94592025-07-01T00:23:28.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5640de2-af29-4a8c-8fea-0df3ecde2ac1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94602025-07-01T00:23:28.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5640de2-af29-4a8c-8fea-0df3ecde2ac1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94612025-07-01T00:23:28.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d5640de2-af29-4a8c-8fea-0df3ecde2ac1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94622025-07-01T00:23:29.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 05216369-941f-4795-b63b-fcd704a36aa3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94632025-07-01T00:23:29.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 05216369-941f-4795-b63b-fcd704a36aa3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94642025-07-01T00:23:29.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3030 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 05216369-941f-4795-b63b-fcd704a36aa3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94652025-07-01T00:23:30.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b01ffc33-88c9-4f8b-b06c-8c66189ac523 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94662025-07-01T00:23:30.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b01ffc33-88c9-4f8b-b06c-8c66189ac523 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94672025-07-01T00:23:30.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b01ffc33-88c9-4f8b-b06c-8c66189ac523 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94682025-07-01T00:23:31.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 06b82077-37f0-4b57-a1d4-74ad00dffe5e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94692025-07-01T00:23:31.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 06b82077-37f0-4b57-a1d4-74ad00dffe5e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94702025-07-01T00:23:31.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 06b82077-37f0-4b57-a1d4-74ad00dffe5e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94712025-07-01T00:23:32.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53b0c6c2-c1d7-4eae-b298-2cdd23c793a1 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94722025-07-01T00:23:32.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53b0c6c2-c1d7-4eae-b298-2cdd23c793a1 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94732025-07-01T00:23:32.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 53b0c6c2-c1d7-4eae-b298-2cdd23c793a1 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94742025-07-01T00:23:33.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 14f87351-e59f-4c7c-a241-fb889d6dabc9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94752025-07-01T00:23:33.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 14f87351-e59f-4c7c-a241-fb889d6dabc9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94762025-07-01T00:23:33.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 14f87351-e59f-4c7c-a241-fb889d6dabc9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94772025-07-01T00:23:33.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
94782025-07-01T00:23:33.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94792025-07-01T00:23:33.904ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
94802025-07-01T00:23:33.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94812025-07-01T00:23:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94822025-07-01T00:23:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94832025-07-01T00:23:33.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94842025-07-01T00:23:33.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94852025-07-01T00:23:33.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94862025-07-01T00:23:33.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.970078ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94872025-07-01T00:23:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94882025-07-01T00:23:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94892025-07-01T00:23:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94902025-07-01T00:23:33.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94912025-07-01T00:23:33.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94922025-07-01T00:23:33.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94932025-07-01T00:23:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
94942025-07-01T00:23:33.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94952025-07-01T00:23:33.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94962025-07-01T00:23:33.929ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
94972025-07-01T00:23:33.929ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.308123ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
94982025-07-01T00:23:34.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88b17cfc-f85c-4b23-9884-5dadb009dbff roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
94992025-07-01T00:23:34.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88b17cfc-f85c-4b23-9884-5dadb009dbff resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95002025-07-01T00:23:34.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 88b17cfc-f85c-4b23-9884-5dadb009dbff response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95012025-07-01T00:23:34.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 530 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 6760bf1b-1923-4a85-96bc-ad2e67e835d9 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
95022025-07-01T00:23:35.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 30319886-dfdc-4250-b026-cf47bb710c52 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95032025-07-01T00:23:35.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 30319886-dfdc-4250-b026-cf47bb710c52 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95042025-07-01T00:23:35.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 30319886-dfdc-4250-b026-cf47bb710c52 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95052025-07-01T00:23:36.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ad6667a4-6c15-4f03-b783-8a7281bcead4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95062025-07-01T00:23:36.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ad6667a4-6c15-4f03-b783-8a7281bcead4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95072025-07-01T00:23:36.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2780 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ad6667a4-6c15-4f03-b783-8a7281bcead4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95082025-07-01T00:23:37.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4574a85b-567c-47a5-90eb-21fa4928272f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95092025-07-01T00:23:37.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4574a85b-567c-47a5-90eb-21fa4928272f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95102025-07-01T00:23:37.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 4574a85b-567c-47a5-90eb-21fa4928272f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95112025-07-01T00:23:38.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6cd2bd97-31bf-4068-bcb7-69d7ba107a1b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95122025-07-01T00:23:38.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6cd2bd97-31bf-4068-bcb7-69d7ba107a1b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95132025-07-01T00:23:38.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6cd2bd97-31bf-4068-bcb7-69d7ba107a1b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95142025-07-01T00:23:39.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 187f3b5f-6b6d-42aa-b9cc-99b027efd9e5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95152025-07-01T00:23:39.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 187f3b5f-6b6d-42aa-b9cc-99b027efd9e5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95162025-07-01T00:23:39.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 187f3b5f-6b6d-42aa-b9cc-99b027efd9e5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95172025-07-01T00:23:40.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c73021c-daff-48ca-a8c7-03e17e4853bb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95182025-07-01T00:23:40.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c73021c-daff-48ca-a8c7-03e17e4853bb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95192025-07-01T00:23:40.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5c73021c-daff-48ca-a8c7-03e17e4853bb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95202025-07-01T00:23:41.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bfac4b2e-1f79-4526-8877-134c5219c63b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95212025-07-01T00:23:41.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bfac4b2e-1f79-4526-8877-134c5219c63b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95222025-07-01T00:23:41.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bfac4b2e-1f79-4526-8877-134c5219c63b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95232025-07-01T00:23:42.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 885a1994-3dee-4eb8-b568-0ea18a98e72e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95242025-07-01T00:23:42.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 885a1994-3dee-4eb8-b568-0ea18a98e72e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95252025-07-01T00:23:42.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 885a1994-3dee-4eb8-b568-0ea18a98e72e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95262025-07-01T00:23:43.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 41f4ba2d-9a67-4df3-a363-2e76686596fe roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95272025-07-01T00:23:43.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 41f4ba2d-9a67-4df3-a363-2e76686596fe resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95282025-07-01T00:23:43.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 41f4ba2d-9a67-4df3-a363-2e76686596fe response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95292025-07-01T00:23:43.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
95302025-07-01T00:23:43.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
95312025-07-01T00:23:43.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95322025-07-01T00:23:43.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95332025-07-01T00:23:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95342025-07-01T00:23:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95352025-07-01T00:23:43.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95362025-07-01T00:23:43.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95372025-07-01T00:23:43.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95382025-07-01T00:23:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.250416ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95392025-07-01T00:23:43.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95402025-07-01T00:23:43.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95412025-07-01T00:23:43.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95422025-07-01T00:23:43.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95432025-07-01T00:23:43.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95442025-07-01T00:23:43.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95452025-07-01T00:23:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
95462025-07-01T00:23:43.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95472025-07-01T00:23:43.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95482025-07-01T00:23:43.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
95492025-07-01T00:23:43.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.74199ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
95502025-07-01T00:23:44.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd76c049-f4ee-4872-975d-03eb442d4a3c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95512025-07-01T00:23:44.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd76c049-f4ee-4872-975d-03eb442d4a3c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95522025-07-01T00:23:44.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = bd76c049-f4ee-4872-975d-03eb442d4a3c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95532025-07-01T00:23:44.923ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 859 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 91e9aa63-c46a-45da-93a1-2d4d5da995f4 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
95542025-07-01T00:23:45.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e7c18e61-0b88-4865-9540-f79c978e8243 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95552025-07-01T00:23:45.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e7c18e61-0b88-4865-9540-f79c978e8243 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95562025-07-01T00:23:45.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = e7c18e61-0b88-4865-9540-f79c978e8243 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95572025-07-01T00:23:46.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5767433a-ef1f-4c99-a1e6-25e700399e96 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95582025-07-01T00:23:46.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5767433a-ef1f-4c99-a1e6-25e700399e96 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95592025-07-01T00:23:46.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2754 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5767433a-ef1f-4c99-a1e6-25e700399e96 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95602025-07-01T00:23:47.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c91995e-0753-4003-a54a-f23956f3e66b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95612025-07-01T00:23:47.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c91995e-0753-4003-a54a-f23956f3e66b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95622025-07-01T00:23:47.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9c91995e-0753-4003-a54a-f23956f3e66b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95632025-07-01T00:23:48.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 759a0f7e-47bc-4af7-806a-5bf82f72e0a8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95642025-07-01T00:23:48.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 759a0f7e-47bc-4af7-806a-5bf82f72e0a8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95652025-07-01T00:23:48.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 759a0f7e-47bc-4af7-806a-5bf82f72e0a8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95662025-07-01T00:23:49.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 41746710-91e8-45ea-8f9f-a2433933c42d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95672025-07-01T00:23:49.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 41746710-91e8-45ea-8f9f-a2433933c42d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95682025-07-01T00:23:49.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 41746710-91e8-45ea-8f9f-a2433933c42d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95692025-07-01T00:23:49.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:63753
95702025-07-01T00:23:49.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = f2af6474-be1c-4541-8e80-9612f22d0af2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
95712025-07-01T00:23:49.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = f2af6474-be1c-4541-8e80-9612f22d0af2 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
95722025-07-01T00:23:49.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = f2af6474-be1c-4541-8e80-9612f22d0af2 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
95732025-07-01T00:23:49.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = 5b6b4003-1f43-47b4-8f75-265e6a704aa9 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
95742025-07-01T00:23:49.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = 5b6b4003-1f43-47b4-8f75-265e6a704aa9 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
95752025-07-01T00:23:49.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = 5b6b4003-1f43-47b4-8f75-265e6a704aa9 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
95762025-07-01T00:23:50.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 165a9edc-50f0-4e8e-a4c2-f3846fb63816 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95772025-07-01T00:23:50.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 165a9edc-50f0-4e8e-a4c2-f3846fb63816 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95782025-07-01T00:23:50.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 165a9edc-50f0-4e8e-a4c2-f3846fb63816 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95792025-07-01T00:23:51.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f28ca02-d1eb-4ff2-9ed3-5a9f665b7a27 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95802025-07-01T00:23:51.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f28ca02-d1eb-4ff2-9ed3-5a9f665b7a27 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95812025-07-01T00:23:51.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f28ca02-d1eb-4ff2-9ed3-5a9f665b7a27 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95822025-07-01T00:23:52.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db269a82-bc55-4ec0-9b7e-e4e710201bd6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95832025-07-01T00:23:52.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db269a82-bc55-4ec0-9b7e-e4e710201bd6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95842025-07-01T00:23:52.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1765 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db269a82-bc55-4ec0-9b7e-e4e710201bd6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95852025-07-01T00:23:53.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 507719c3-c822-448f-b848-6e1df18991fb roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95862025-07-01T00:23:53.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 507719c3-c822-448f-b848-6e1df18991fb resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95872025-07-01T00:23:53.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2865 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 507719c3-c822-448f-b848-6e1df18991fb response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
95882025-07-01T00:23:53.901ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
95892025-07-01T00:23:53.901ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
95902025-07-01T00:23:53.901ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
95912025-07-01T00:23:53.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95922025-07-01T00:23:53.901ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95932025-07-01T00:23:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95942025-07-01T00:23:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95952025-07-01T00:23:53.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
95962025-07-01T00:23:53.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
95972025-07-01T00:23:53.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
95982025-07-01T00:23:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95992025-07-01T00:23:53.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96002025-07-01T00:23:53.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96012025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
96022025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
96032025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96042025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96052025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
96062025-07-01T00:23:53.904ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96072025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
96082025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96092025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
96102025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96112025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96122025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
96132025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96142025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
96152025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96162025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96172025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
96182025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96192025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96202025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96212025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96222025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96232025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96242025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96252025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96262025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96272025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96282025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96292025-07-01T00:23:53.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96302025-07-01T00:23:53.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 729552526 } })
96312025-07-01T00:23:53.905ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.175367ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96322025-07-01T00:23:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
96332025-07-01T00:23:53.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 730087321 } })
96342025-07-01T00:23:53.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
96352025-07-01T00:23:53.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96362025-07-01T00:23:53.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372025-07-01T00:23:53.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96382025-07-01T00:23:53.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96392025-07-01T00:23:53.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402025-07-01T00:23:53.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96412025-07-01T00:23:53.908ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96422025-07-01T00:23:53.908ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96432025-07-01T00:23:53.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96442025-07-01T00:23:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96452025-07-01T00:23:53.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96462025-07-01T00:23:53.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96472025-07-01T00:23:53.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96482025-07-01T00:23:53.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.753577ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96492025-07-01T00:23:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96502025-07-01T00:23:53.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96512025-07-01T00:23:53.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96522025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96532025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96542025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96552025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96562025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96572025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96582025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96592025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96602025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96612025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96622025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96632025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96642025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96652025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96662025-07-01T00:23:53.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96672025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96682025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96692025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96702025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96712025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
96722025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
96732025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96742025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96752025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
96762025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
96772025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
96782025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96792025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
96802025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96812025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
96822025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96832025-07-01T00:23:53.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96842025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
96852025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96862025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96872025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96882025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96892025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96902025-07-01T00:23:53.914ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 738827680 } })
96912025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96922025-07-01T00:23:53.914ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 739393105 } })
96932025-07-01T00:23:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96942025-07-01T00:23:53.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96952025-07-01T00:23:53.915ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
96962025-07-01T00:23:53.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96972025-07-01T00:23:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96982025-07-01T00:23:53.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96992025-07-01T00:23:53.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97002025-07-01T00:23:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97012025-07-01T00:23:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97022025-07-01T00:23:53.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97032025-07-01T00:23:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97042025-07-01T00:23:53.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97052025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.134937ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97062025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97072025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97082025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97092025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97102025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.822791ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
97112025-07-01T00:23:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97122025-07-01T00:23:53.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97132025-07-01T00:23:53.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97142025-07-01T00:23:53.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97152025-07-01T00:23:53.922ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97162025-07-01T00:23:53.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97172025-07-01T00:23:53.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
97182025-07-01T00:23:53.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97192025-07-01T00:23:53.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97202025-07-01T00:23:53.935ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
97212025-07-01T00:23:53.935ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.399399ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
97222025-07-01T00:23:53.949ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97232025-07-01T00:23:53.949ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97242025-07-01T00:23:53.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97252025-07-01T00:23:53.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97262025-07-01T00:23:53.949ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97272025-07-01T00:23:53.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97282025-07-01T00:23:53.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97292025-07-01T00:23:53.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97302025-07-01T00:23:53.951ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97312025-07-01T00:23:53.951ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97322025-07-01T00:23:53.952ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 47.910931ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97332025-07-01T00:23:53.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.69092ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97342025-07-01T00:23:53.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97352025-07-01T00:23:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97362025-07-01T00:23:53.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.509275ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
97372025-07-01T00:23:53.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97382025-07-01T00:23:53.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97392025-07-01T00:23:53.958ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97402025-07-01T00:23:53.960ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
97412025-07-01T00:23:53.960ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 56.395433ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
97422025-07-01T00:23:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
97432025-07-01T00:23:53.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97442025-07-01T00:23:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97452025-07-01T00:23:53.963ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.537289ms iteration = 26 status = 0
97462025-07-01T00:23:53.965ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 52.131666ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
97472025-07-01T00:23:53.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97482025-07-01T00:23:53.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97492025-07-01T00:23:53.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.862079ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97502025-07-01T00:23:53.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.651141ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
97512025-07-01T00:23:54.010ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
97522025-07-01T00:23:54.010ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97532025-07-01T00:23:54.010ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9a7ebd4-aba0-44da-9786-9ba2cf349cfa", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
97542025-07-01T00:23:54.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97552025-07-01T00:23:54.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97562025-07-01T00:23:54.025ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
97572025-07-01T00:23:54.025ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97582025-07-01T00:23:54.025ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43dc146d-6593-44ed-b400-c07d1b5a8b92", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
97592025-07-01T00:23:54.025ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97602025-07-01T00:23:54.028ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
97612025-07-01T00:23:54.033ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.493293ms iteration = 29 status = {"physical_disks_added":0}
97622025-07-01T00:23:54.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97632025-07-01T00:23:54.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97642025-07-01T00:23:54.042ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
97652025-07-01T00:23:54.042ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97662025-07-01T00:23:54.043ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08571ca7-0d82-48ed-b2dc-cf08a76d641b", "content-length": "26", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
97672025-07-01T00:23:54.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97682025-07-01T00:23:54.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97692025-07-01T00:23:54.044ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97702025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
97712025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97722025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97732025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97742025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ead29f6-0f85-45f5-a3a0-fa6ecc600e5c", "content-length": "78", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
97752025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
97762025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
97772025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
97782025-07-01T00:23:54.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
97792025-07-01T00:23:54.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
97802025-07-01T00:23:54.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
97812025-07-01T00:23:54.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97822025-07-01T00:23:54.047ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
97832025-07-01T00:23:54.048ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
97842025-07-01T00:23:54.048ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
97852025-07-01T00:23:54.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97862025-07-01T00:23:54.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97872025-07-01T00:23:54.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97882025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
97892025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
97902025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
97912025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
97922025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
97932025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
97942025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
97952025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
97962025-07-01T00:23:54.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
97972025-07-01T00:23:54.052ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
97982025-07-01T00:23:54.052ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
97992025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "51855262-5a02-4317-a090-37a4da44fa16", "content-length": "81", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98002025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
98012025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
98022025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
98032025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
98042025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7007eb7a-bd39-4539-8ba5-7a5ae6cf03a8", "content-length": "81", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98052025-07-01T00:23:54.053ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "63224e57-3c32-4425-b3fb-a6ae52a46b12", "content-length": "81", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98062025-07-01T00:23:54.055ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 141.514051ms iteration = 26 status = {"errors":[],"sps":[]}
98072025-07-01T00:23:54.120ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98082025-07-01T00:23:54.120ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98092025-07-01T00:23:54.121ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4dcb61d-6a6f-4ff6-9dd3-46d7b3ad0d4a", "content-length": "372", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98102025-07-01T00:23:54.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98112025-07-01T00:23:54.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98122025-07-01T00:23:54.137ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
98132025-07-01T00:23:54.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98142025-07-01T00:23:54.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a1b19f04-e581-448c-ae2f-4e1e32a2d949", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98152025-07-01T00:23:54.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98162025-07-01T00:23:54.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98172025-07-01T00:23:54.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98182025-07-01T00:23:54.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98192025-07-01T00:23:54.142ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98202025-07-01T00:23:54.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98212025-07-01T00:23:54.147ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 245.165318ms iteration = 26 status = null
98222025-07-01T00:23:54.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98232025-07-01T00:23:54.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98242025-07-01T00:23:54.154ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98252025-07-01T00:23:54.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98262025-07-01T00:23:54.154ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cbc79675-4842-4a7d-8e05-367c7c49c510", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98272025-07-01T00:23:54.156ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 252.640523ms iteration = 27 status = {}
98282025-07-01T00:23:54.158ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 256.228951ms iteration = 26 status = {}
98292025-07-01T00:23:54.158ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98302025-07-01T00:23:54.159ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c796104d-de4b-4c40-ac45-c41b27699984", "content-length": "691", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98312025-07-01T00:23:54.159ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
98322025-07-01T00:23:54.159ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
98332025-07-01T00:23:54.159ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
98342025-07-01T00:23:54.161ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.651299ms iteration = 27 status = {}
98352025-07-01T00:23:54.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98362025-07-01T00:23:54.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98372025-07-01T00:23:54.224ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
98382025-07-01T00:23:54.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98392025-07-01T00:23:54.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98402025-07-01T00:23:54.234ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
98412025-07-01T00:23:54.234ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
98422025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98432025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98442025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98452025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98462025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98472025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98482025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98492025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98502025-07-01T00:23:54.235ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
98512025-07-01T00:23:54.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98522025-07-01T00:23:54.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98532025-07-01T00:23:54.237ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
98542025-07-01T00:23:54.237ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98552025-07-01T00:23:54.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6a53c456-d997-4c46-9e13-68a992744b8d", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98562025-07-01T00:23:54.339ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
98572025-07-01T00:23:54.339ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98582025-07-01T00:23:54.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1f76df4-0c6d-4e0c-bb34-75210cf3a359", "content-length": "682", "date": "Tue, 01 Jul 2025 00:23:54 GMT"} })
98592025-07-01T00:23:54.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98602025-07-01T00:23:54.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98612025-07-01T00:23:54.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98622025-07-01T00:23:54.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98632025-07-01T00:23:54.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98642025-07-01T00:23:54.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98652025-07-01T00:23:54.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98662025-07-01T00:23:54.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98672025-07-01T00:23:54.358ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 454.282458ms iteration = 26 status = {}
98682025-07-01T00:23:54.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5e813147-f030-480c-b32d-2cb16c09f1f4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98692025-07-01T00:23:54.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5e813147-f030-480c-b32d-2cb16c09f1f4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98702025-07-01T00:23:54.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5e813147-f030-480c-b32d-2cb16c09f1f4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98712025-07-01T00:23:54.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 508 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = e8a8098e-aeb9-4d53-b006-202774fd7371 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
98722025-07-01T00:23:55.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 900b9330-e9c8-456c-a706-d671607c1cf4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98732025-07-01T00:23:55.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 900b9330-e9c8-456c-a706-d671607c1cf4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98742025-07-01T00:23:55.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2570 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 900b9330-e9c8-456c-a706-d671607c1cf4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98752025-07-01T00:23:56.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 181f9164-eaba-4eff-be66-f026a00f9371 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98762025-07-01T00:23:56.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 181f9164-eaba-4eff-be66-f026a00f9371 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98772025-07-01T00:23:56.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 181f9164-eaba-4eff-be66-f026a00f9371 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98782025-07-01T00:23:57.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f7f82379-a6ba-4ad3-a564-ce090d782366 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98792025-07-01T00:23:57.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f7f82379-a6ba-4ad3-a564-ce090d782366 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98802025-07-01T00:23:57.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f7f82379-a6ba-4ad3-a564-ce090d782366 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98812025-07-01T00:23:58.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f1d50aa-efd8-4063-b80f-3848c1529ca4 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98822025-07-01T00:23:58.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f1d50aa-efd8-4063-b80f-3848c1529ca4 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98832025-07-01T00:23:58.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6f1d50aa-efd8-4063-b80f-3848c1529ca4 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98842025-07-01T00:23:59.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5f7e3b0-a5df-4098-8743-08dd2d3a20bf roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98852025-07-01T00:23:59.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5f7e3b0-a5df-4098-8743-08dd2d3a20bf resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98862025-07-01T00:23:59.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f5f7e3b0-a5df-4098-8743-08dd2d3a20bf response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98872025-07-01T00:24:00.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8309bf43-4a12-4d10-a70f-44f59c0f59d9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98882025-07-01T00:24:00.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8309bf43-4a12-4d10-a70f-44f59c0f59d9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98892025-07-01T00:24:00.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8309bf43-4a12-4d10-a70f-44f59c0f59d9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98902025-07-01T00:24:01.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b69f22bd-d3ca-4ca6-9236-9f8ca5ca2ca7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98912025-07-01T00:24:01.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b69f22bd-d3ca-4ca6-9236-9f8ca5ca2ca7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98922025-07-01T00:24:01.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2796 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b69f22bd-d3ca-4ca6-9236-9f8ca5ca2ca7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98932025-07-01T00:24:02.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a44f4b16-fb14-4183-ac23-531ff46569c5 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98942025-07-01T00:24:02.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a44f4b16-fb14-4183-ac23-531ff46569c5 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98952025-07-01T00:24:02.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = a44f4b16-fb14-4183-ac23-531ff46569c5 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98962025-07-01T00:24:03.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 42ac4823-79aa-47e4-a65f-0431ee57324d roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98972025-07-01T00:24:03.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 42ac4823-79aa-47e4-a65f-0431ee57324d resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98982025-07-01T00:24:03.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 42ac4823-79aa-47e4-a65f-0431ee57324d response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
98992025-07-01T00:24:03.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
99002025-07-01T00:24:03.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99012025-07-01T00:24:03.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
99022025-07-01T00:24:03.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99032025-07-01T00:24:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99042025-07-01T00:24:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99052025-07-01T00:24:03.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99062025-07-01T00:24:03.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99072025-07-01T00:24:03.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99082025-07-01T00:24:03.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.722132ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99092025-07-01T00:24:03.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99102025-07-01T00:24:03.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99112025-07-01T00:24:03.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99122025-07-01T00:24:03.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99132025-07-01T00:24:03.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99142025-07-01T00:24:03.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99152025-07-01T00:24:03.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
99162025-07-01T00:24:03.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99172025-07-01T00:24:03.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99182025-07-01T00:24:03.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
99192025-07-01T00:24:03.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.765383ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
99202025-07-01T00:24:04.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 90bf477f-06e9-45d4-8d15-93a4b96e0d8f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99212025-07-01T00:24:04.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 90bf477f-06e9-45d4-8d15-93a4b96e0d8f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99222025-07-01T00:24:04.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 90bf477f-06e9-45d4-8d15-93a4b96e0d8f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99232025-07-01T00:24:04.923ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 585 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = fa8d23c5-34c8-498b-8682-45b4dbfe1fd0 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
99242025-07-01T00:24:05.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 465ceb71-d653-4b21-ae25-9a6c95a48a2f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99252025-07-01T00:24:05.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 465ceb71-d653-4b21-ae25-9a6c95a48a2f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99262025-07-01T00:24:05.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 465ceb71-d653-4b21-ae25-9a6c95a48a2f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99272025-07-01T00:24:06.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2a9060a8-f725-44ae-bf43-5bf0bf05a74c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99282025-07-01T00:24:06.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2a9060a8-f725-44ae-bf43-5bf0bf05a74c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99292025-07-01T00:24:06.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 2a9060a8-f725-44ae-bf43-5bf0bf05a74c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99302025-07-01T00:24:07.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5a4c2c50-4e70-4ed4-9911-be3d5585540e roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99312025-07-01T00:24:07.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5a4c2c50-4e70-4ed4-9911-be3d5585540e resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99322025-07-01T00:24:07.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 5a4c2c50-4e70-4ed4-9911-be3d5585540e response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99332025-07-01T00:24:08.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 04abb124-f688-4771-a812-fc6459d4ff8b roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99342025-07-01T00:24:08.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 04abb124-f688-4771-a812-fc6459d4ff8b resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99352025-07-01T00:24:08.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1987 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 04abb124-f688-4771-a812-fc6459d4ff8b response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99362025-07-01T00:24:09.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3239685a-03f3-414d-914c-942f82501dc3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99372025-07-01T00:24:09.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3239685a-03f3-414d-914c-942f82501dc3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99382025-07-01T00:24:09.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 3239685a-03f3-414d-914c-942f82501dc3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99392025-07-01T00:24:10.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f44cb7fa-97b0-4159-a9f7-834a46ce2c39 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99402025-07-01T00:24:10.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f44cb7fa-97b0-4159-a9f7-834a46ce2c39 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99412025-07-01T00:24:10.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = f44cb7fa-97b0-4159-a9f7-834a46ce2c39 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99422025-07-01T00:24:11.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 92a47685-ac41-4511-a599-a69563c2ef7c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99432025-07-01T00:24:11.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 92a47685-ac41-4511-a599-a69563c2ef7c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99442025-07-01T00:24:11.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 92a47685-ac41-4511-a599-a69563c2ef7c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99452025-07-01T00:24:12.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 864665c5-9603-4fad-89bb-faf31b2befda roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99462025-07-01T00:24:12.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 864665c5-9603-4fad-89bb-faf31b2befda resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99472025-07-01T00:24:12.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2464 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 864665c5-9603-4fad-89bb-faf31b2befda response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99482025-07-01T00:24:13.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
99492025-07-01T00:24:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99502025-07-01T00:24:13.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
99512025-07-01T00:24:13.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99522025-07-01T00:24:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99532025-07-01T00:24:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99542025-07-01T00:24:13.905ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99552025-07-01T00:24:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99562025-07-01T00:24:13.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99572025-07-01T00:24:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.889347ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99582025-07-01T00:24:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99592025-07-01T00:24:13.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99602025-07-01T00:24:13.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99612025-07-01T00:24:13.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99622025-07-01T00:24:13.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99632025-07-01T00:24:13.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99642025-07-01T00:24:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
99652025-07-01T00:24:13.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99662025-07-01T00:24:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99672025-07-01T00:24:13.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 99eaf732-3d49-4547-b81f-e4ec6f56c753 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99682025-07-01T00:24:13.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 99eaf732-3d49-4547-b81f-e4ec6f56c753 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99692025-07-01T00:24:13.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1753 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 99eaf732-3d49-4547-b81f-e4ec6f56c753 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99702025-07-01T00:24:13.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
99712025-07-01T00:24:13.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.91515ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
99722025-07-01T00:24:14.922ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 609 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 5175c863-6f5f-4512-abfb-83899457d755 response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
99732025-07-01T00:24:14.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9e2553a5-b9a1-497e-ad53-2545cd149f64 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99742025-07-01T00:24:14.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9e2553a5-b9a1-497e-ad53-2545cd149f64 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99752025-07-01T00:24:14.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9e2553a5-b9a1-497e-ad53-2545cd149f64 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99762025-07-01T00:24:15.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 13ff16ba-4fe4-4e4e-b424-d6ba5436fd12 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99772025-07-01T00:24:15.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 13ff16ba-4fe4-4e4e-b424-d6ba5436fd12 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99782025-07-01T00:24:15.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 13ff16ba-4fe4-4e4e-b424-d6ba5436fd12 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99792025-07-01T00:24:16.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a914181-971c-469e-9b6b-0e6cf1494cce roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99802025-07-01T00:24:16.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a914181-971c-469e-9b6b-0e6cf1494cce resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99812025-07-01T00:24:16.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8a914181-971c-469e-9b6b-0e6cf1494cce response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99822025-07-01T00:24:17.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 92cff904-bdef-4600-acc1-ec8b50017ca8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99832025-07-01T00:24:17.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 92cff904-bdef-4600-acc1-ec8b50017ca8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99842025-07-01T00:24:17.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 92cff904-bdef-4600-acc1-ec8b50017ca8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99852025-07-01T00:24:19.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25083f5d-f6f1-4f3c-902f-6e73ce44d9ad roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99862025-07-01T00:24:19.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25083f5d-f6f1-4f3c-902f-6e73ce44d9ad resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99872025-07-01T00:24:19.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 25083f5d-f6f1-4f3c-902f-6e73ce44d9ad response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99882025-07-01T00:24:19.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = defd5983-2258-4c3b-8d75-124e21069a74 roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
99892025-07-01T00:24:19.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = defd5983-2258-4c3b-8d75-124e21069a74 resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
99902025-07-01T00:24:19.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = defd5983-2258-4c3b-8d75-124e21069a74 response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?sort_by=id_ascending
99912025-07-01T00:24:19.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = a8fcbefc-abf8-4afb-bdb3-dc8af7c7e09b roles = RoleSet { roles: {} } uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
99922025-07-01T00:24:19.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = a8fcbefc-abf8-4afb-bdb3-dc8af7c7e09b resource = Database result = Ok(()) uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
99932025-07-01T00:24:19.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63753 req_id = a8fcbefc-abf8-4afb-bdb3-dc8af7c7e09b response_code = 200 uri = /metrics/collectors/a8a4439d-9bed-4df3-9921-c50bfb72fc42/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMjU4ZDgwZC0yNzlhLTRlNGQtODIxMS0zNTlhMjliMzdhOGMifX0%3D
99942025-07-01T00:24:20.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d1443f32-db69-49da-9448-88178b995658 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99952025-07-01T00:24:20.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d1443f32-db69-49da-9448-88178b995658 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99962025-07-01T00:24:20.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d1443f32-db69-49da-9448-88178b995658 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99972025-07-01T00:24:21.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9463990e-f80e-4863-8915-88eff07f1571 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99982025-07-01T00:24:21.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9463990e-f80e-4863-8915-88eff07f1571 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
99992025-07-01T00:24:21.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9463990e-f80e-4863-8915-88eff07f1571 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100002025-07-01T00:24:22.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ecd9b8b1-3250-40db-9157-4a67285e616f roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100012025-07-01T00:24:22.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ecd9b8b1-3250-40db-9157-4a67285e616f resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100022025-07-01T00:24:22.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = ecd9b8b1-3250-40db-9157-4a67285e616f response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100032025-07-01T00:24:23.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6fe411ce-1ff8-46f0-8aac-d5b940631ac8 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100042025-07-01T00:24:23.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6fe411ce-1ff8-46f0-8aac-d5b940631ac8 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100052025-07-01T00:24:23.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 6fe411ce-1ff8-46f0-8aac-d5b940631ac8 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
100062025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
100072025-07-01T00:24:23.902ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c9f74bdf-f99d-492a-9cce-6960da102c33
100082025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.23\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33"}
100092025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
100102025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
100112025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100122025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100132025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
100142025-07-01T00:24:23.902ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-01 00:14:23.902629427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100152025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
100162025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
100172025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
100182025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
100192025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100202025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
100212025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
100222025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100232025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
100242025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100252025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
100262025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100272025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
100282025-07-01T00:24:23.902ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
100292025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100302025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100312025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100322025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100332025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100342025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100352025-07-01T00:24:23.903ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("41eebb95-a44a-4913-b805-5e5fb485fcae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e0ddf814-75e5-4f70-adea-4a3baebe5d2e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 727887581 } })
100362025-07-01T00:24:23.903ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("20701835-eb46-4b13-bcdb-4e397f3852ed.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d3e7192-57c7-489c-aa0a-9731fca6b096.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("ce77426f-85ba-4b88-b8d2-7854f2cd088e.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 727887711 } })
100372025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 18 reason = Timeout
100382025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
100392025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 12.03\u{b5}s iteration = 18 status = "Disabled"
100402025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
100412025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100422025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
100432025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
100442025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
100452025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100462025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100472025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100482025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
100492025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100502025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100512025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
100522025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100532025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
100542025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100552025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
100562025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100572025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
100582025-07-01T00:24:23.903ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100592025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
100602025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100612025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100622025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
100632025-07-01T00:24:23.903ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
100642025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100652025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
100662025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
100672025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100682025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100692025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
100702025-07-01T00:24:23.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100712025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100722025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100732025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100742025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
100752025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.49177ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
100762025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100772025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100782025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
100792025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.522471ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
100802025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100812025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100822025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100832025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100842025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100852025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100862025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100872025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100882025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100892025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100902025-07-01T00:24:23.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100912025-07-01T00:24:23.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-01 00:14:23.902629427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
100922025-07-01T00:24:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.66336ms iteration = 14 status = {"expiration":"2025-07-01T00:14:23.902629427Z","pruned":[]}
100932025-07-01T00:24:23.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100942025-07-01T00:24:23.906ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.754463ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100952025-07-01T00:24:23.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100962025-07-01T00:24:23.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100972025-07-01T00:24:23.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 731916281 } })
100982025-07-01T00:24:23.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1193
100992025-07-01T00:24:23.908ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 732851556 } })
101002025-07-01T00:24:23.908ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101012025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101022025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101032025-07-01T00:24:23.908ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1193
101042025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101052025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101062025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101072025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101082025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101092025-07-01T00:24:23.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101102025-07-01T00:24:23.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101112025-07-01T00:24:23.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101122025-07-01T00:24:23.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132025-07-01T00:24:23.910ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101142025-07-01T00:24:23.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101152025-07-01T00:24:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101162025-07-01T00:24:23.911ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101172025-07-01T00:24:23.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101182025-07-01T00:24:23.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101192025-07-01T00:24:23.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101202025-07-01T00:24:23.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101212025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101222025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101242025-07-01T00:24:23.913ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101252025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.710366ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101262025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
101272025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
101282025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
101292025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
101302025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101312025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
101322025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101332025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
101342025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
101352025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
101362025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
101372025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
101382025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101392025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101402025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
101412025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101422025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
101432025-07-01T00:24:23.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101442025-07-01T00:24:23.914ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 738720657 } })
101452025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
101462025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
101472025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
101482025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
101492025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101502025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101512025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101522025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101532025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101542025-07-01T00:24:23.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101552025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101562025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101572025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101582025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101592025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
101602025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101612025-07-01T00:24:23.915ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101622025-07-01T00:24:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101632025-07-01T00:24:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101642025-07-01T00:24:23.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101652025-07-01T00:24:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101662025-07-01T00:24:23.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101672025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101682025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101692025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101702025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.950146ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
101712025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101722025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101732025-07-01T00:24:23.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101742025-07-01T00:24:23.919ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
101752025-07-01T00:24:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101762025-07-01T00:24:23.919ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.432358ms iteration = 14 status = {"by_rx":{},"error":null}
101772025-07-01T00:24:23.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101782025-07-01T00:24:23.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.356134ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
101792025-07-01T00:24:23.920ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
101802025-07-01T00:24:23.920ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
101812025-07-01T00:24:23.920ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
101822025-07-01T00:24:23.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101832025-07-01T00:24:23.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101842025-07-01T00:24:23.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101852025-07-01T00:24:23.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101862025-07-01T00:24:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101872025-07-01T00:24:23.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101882025-07-01T00:24:23.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101892025-07-01T00:24:23.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101902025-07-01T00:24:23.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101912025-07-01T00:24:23.924ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
101922025-07-01T00:24:23.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101932025-07-01T00:24:23.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
101942025-07-01T00:24:23.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.220747ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101952025-07-01T00:24:23.925ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-887ec56b-486c-42d4-930b-b7b47cbacc61.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1793, tv_nsec: 749766589 } })
101962025-07-01T00:24:23.925ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1193 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
101972025-07-01T00:24:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101982025-07-01T00:24:23.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101992025-07-01T00:24:23.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102002025-07-01T00:24:23.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102012025-07-01T00:24:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102022025-07-01T00:24:23.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102032025-07-01T00:24:23.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102042025-07-01T00:24:23.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102052025-07-01T00:24:23.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102062025-07-01T00:24:23.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102072025-07-01T00:24:23.940ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 26.854075ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
102082025-07-01T00:24:23.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102092025-07-01T00:24:23.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102102025-07-01T00:24:23.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.09902ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102112025-07-01T00:24:23.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102122025-07-01T00:24:23.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.010146ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102132025-07-01T00:24:23.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.413631ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
102142025-07-01T00:24:23.971ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102152025-07-01T00:24:23.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102162025-07-01T00:24:23.973ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 59.392215ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
102172025-07-01T00:24:23.973ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102182025-07-01T00:24:23.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102192025-07-01T00:24:23.974ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102202025-07-01T00:24:23.974ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102212025-07-01T00:24:23.974ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102222025-07-01T00:24:23.975ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102232025-07-01T00:24:23.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102242025-07-01T00:24:23.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.437134ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102252025-07-01T00:24:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102262025-07-01T00:24:23.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102272025-07-01T00:24:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
102282025-07-01T00:24:23.976ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102292025-07-01T00:24:23.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102302025-07-01T00:24:23.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102312025-07-01T00:24:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102322025-07-01T00:24:23.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102332025-07-01T00:24:23.977ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102342025-07-01T00:24:23.977ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102352025-07-01T00:24:23.977ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102362025-07-01T00:24:23.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102372025-07-01T00:24:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102382025-07-01T00:24:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102392025-07-01T00:24:23.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102402025-07-01T00:24:23.978ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
102412025-07-01T00:24:23.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102422025-07-01T00:24:23.978ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 74.552539ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
102432025-07-01T00:24:23.978ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102442025-07-01T00:24:23.978ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
102452025-07-01T00:24:23.978ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.93278ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102462025-07-01T00:24:23.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102472025-07-01T00:24:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102482025-07-01T00:24:23.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102492025-07-01T00:24:23.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102502025-07-01T00:24:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102512025-07-01T00:24:23.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102522025-07-01T00:24:23.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102532025-07-01T00:24:23.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102542025-07-01T00:24:23.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102552025-07-01T00:24:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102562025-07-01T00:24:23.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102572025-07-01T00:24:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102582025-07-01T00:24:23.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102592025-07-01T00:24:23.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 887ec56b-486c-42d4-930b-b7b47cbacc61, lookup_type: ById(887ec56b-486c-42d4-930b-b7b47cbacc61) } result = Ok(())
102602025-07-01T00:24:23.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102612025-07-01T00:24:23.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102622025-07-01T00:24:23.993ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 89.861628ms iteration = 30 status = {"physical_disks_added":0}
102632025-07-01T00:24:23.994ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102642025-07-01T00:24:23.994ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 0 version = 2
102652025-07-01T00:24:23.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102662025-07-01T00:24:23.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102672025-07-01T00:24:23.995ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.287028ms iteration = 27 status = 0
102682025-07-01T00:24:23.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102692025-07-01T00:24:23.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102702025-07-01T00:24:23.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102712025-07-01T00:24:23.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102722025-07-01T00:24:23.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102732025-07-01T00:24:23.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102742025-07-01T00:24:24.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102752025-07-01T00:24:24.003ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2120a8b0-a196-45c9-b481-a4efea545230 dns_zone_name = oxide.test found_so_far = 4 version = 2
102762025-07-01T00:24:24.003ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
102772025-07-01T00:24:24.003ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-01 00:11:38.262262 UTC dns_group = external generation = 2
102782025-07-01T00:24:24.003ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 100.445738ms iteration = 14 status = {"generation":2}
102792025-07-01T00:24:24.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102802025-07-01T00:24:24.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102812025-07-01T00:24:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102822025-07-01T00:24:24.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102832025-07-01T00:24:24.020ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102842025-07-01T00:24:24.020ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102852025-07-01T00:24:24.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.663452ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102862025-07-01T00:24:24.021ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102872025-07-01T00:24:24.021ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102882025-07-01T00:24:24.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102892025-07-01T00:24:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102902025-07-01T00:24:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
102912025-07-01T00:24:24.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102922025-07-01T00:24:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102932025-07-01T00:24:24.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102942025-07-01T00:24:24.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102952025-07-01T00:24:24.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.904544ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
102962025-07-01T00:24:24.036ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
102972025-07-01T00:24:24.036ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.158596ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
102982025-07-01T00:24:24.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102992025-07-01T00:24:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103002025-07-01T00:24:24.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103012025-07-01T00:24:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103022025-07-01T00:24:24.066ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3e956a00-93e2-4ef5-9af1-d7a8d3943922 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
103032025-07-01T00:24:24.066ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
103042025-07-01T00:24:24.066ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-01 00:11:37.222806 UTC dns_group = internal generation = 1
103052025-07-01T00:24:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 163.458892ms iteration = 14 status = {"generation":1}
103062025-07-01T00:24:24.069ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-01T00:11:16.877096Z, time_modified: 2025-07-01T00:11:16.877096Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: c2846601-f6c6-4baf-a7a2-185cf6c84399, db_silo: Silo { identity: SiloIdentity { id: c2846601-f6c6-4baf-a7a2-185cf6c84399, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-01T00:11:38.210321Z, time_modified: 2025-07-01T00:11:38.210321Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b" }] }) }
103072025-07-01T00:24:24.069ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.186994ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]}},"default_endpoint":{"silo_id":"c2846601-f6c6-4baf-a7a2-185cf6c84399","tls_certs":["1d28d44c30811f65d1d78d71f3c1f13f189411e054b48be6697ec6c89997cf1b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
103082025-07-01T00:24:24.074ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
103092025-07-01T00:24:24.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 171.139242ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103102025-07-01T00:24:24.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8fbf4bfc-a321-47c5-81ae-dea4608b65b0 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
103112025-07-01T00:24:24.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8fbf4bfc-a321-47c5-81ae-dea4608b65b0 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
103122025-07-01T00:24:24.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 8fbf4bfc-a321-47c5-81ae-dea4608b65b0 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
103132025-07-01T00:24:24.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
103142025-07-01T00:24:24.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103152025-07-01T00:24:24.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103162025-07-01T00:24:24.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103172025-07-01T00:24:24.100ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
103182025-07-01T00:24:24.100ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a63cbc2-a8f2-44ef-bfae-1642e616c53d", "content-length": "78", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103192025-07-01T00:24:24.101ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
103202025-07-01T00:24:24.101ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
103212025-07-01T00:24:24.101ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
103222025-07-01T00:24:24.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
103232025-07-01T00:24:24.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
103242025-07-01T00:24:24.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
103252025-07-01T00:24:24.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103262025-07-01T00:24:24.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103272025-07-01T00:24:24.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103282025-07-01T00:24:24.103ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
103292025-07-01T00:24:24.103ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
103302025-07-01T00:24:24.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312025-07-01T00:24:24.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
103322025-07-01T00:24:24.105ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
103332025-07-01T00:24:24.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
103342025-07-01T00:24:24.105ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
103352025-07-01T00:24:24.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
103362025-07-01T00:24:24.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
103372025-07-01T00:24:24.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103382025-07-01T00:24:24.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103392025-07-01T00:24:24.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103402025-07-01T00:24:24.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
103412025-07-01T00:24:24.116ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103422025-07-01T00:24:24.117ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbf023ef-c3cc-41a1-bd91-0908ad543fb2", "content-length": "26", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103432025-07-01T00:24:24.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103442025-07-01T00:24:24.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103452025-07-01T00:24:24.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1201 zone_address = fd00:1122:3344:101::2
103462025-07-01T00:24:24.126ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103472025-07-01T00:24:24.126ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103482025-07-01T00:24:24.128ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8ad64bd-5dcf-408c-9ee0-20e43768769c", "content-length": "26", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103492025-07-01T00:24:24.128ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1204 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103502025-07-01T00:24:24.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103512025-07-01T00:24:24.162ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
103522025-07-01T00:24:24.164ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
103532025-07-01T00:24:24.164ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
103542025-07-01T00:24:24.165ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a30a564-a087-4459-844c-bd38b2708416", "content-length": "81", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103552025-07-01T00:24:24.166ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
103562025-07-01T00:24:24.166ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
103572025-07-01T00:24:24.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
103582025-07-01T00:24:24.166ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
103592025-07-01T00:24:24.166ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f778de-3297-46e0-84b4-7a698c633af0", "content-length": "81", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103602025-07-01T00:24:24.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
103612025-07-01T00:24:24.168ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
103622025-07-01T00:24:24.168ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
103632025-07-01T00:24:24.169ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba55318d-ce5f-4675-b293-30f1607b4c5c", "content-length": "81", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103642025-07-01T00:24:24.171ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 257.249659ms iteration = 27 status = {"errors":[],"sps":[]}
103652025-07-01T00:24:24.299ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1201 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 zone_address = fd00:1122:3344:101::2
103662025-07-01T00:24:24.299ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103672025-07-01T00:24:24.299ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de0cee2d-fe21-489a-b58c-36ed8ab3ab4e", "content-length": "26", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103682025-07-01T00:24:24.299ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1204 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103692025-07-01T00:24:24.302ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1238 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
103702025-07-01T00:24:24.319ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103712025-07-01T00:24:24.319ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103722025-07-01T00:24:24.320ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9462502-383b-4d4d-a428-49ce802e42df", "content-length": "372", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103732025-07-01T00:24:24.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103742025-07-01T00:24:24.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103752025-07-01T00:24:24.324ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103762025-07-01T00:24:24.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103772025-07-01T00:24:24.327ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 424.736379ms iteration = 27 status = null
103782025-07-01T00:24:24.334ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103792025-07-01T00:24:24.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7a8e4e35-9521-4b4b-8e52-7b3642836bac", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103802025-07-01T00:24:24.334ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103812025-07-01T00:24:24.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "85310d48-7a74-4d92-82ef-10514d6395ca", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103822025-07-01T00:24:24.336ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103832025-07-01T00:24:24.339ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103842025-07-01T00:24:24.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 436.81879ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103852025-07-01T00:24:24.345ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
103862025-07-01T00:24:24.352ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 449.555209ms iteration = 27 status = {}
103872025-07-01T00:24:24.373ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103882025-07-01T00:24:24.373ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103892025-07-01T00:24:24.373ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4af5bd8b-df79-454f-8a11-4295c810c401", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103902025-07-01T00:24:24.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103912025-07-01T00:24:24.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103922025-07-01T00:24:24.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103932025-07-01T00:24:24.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103942025-07-01T00:24:24.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103952025-07-01T00:24:24.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103962025-07-01T00:24:24.384ZINFOnexus (BackgroundTasks): VPC route manager sled 887ec56b-486c-42d4-930b-b7b47cbacc61 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103972025-07-01T00:24:24.384ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103982025-07-01T00:24:24.384ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4098f14c-c25b-4a4b-a8ea-1006220b6ad8", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
103992025-07-01T00:24:24.386ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 482.621653ms iteration = 28 status = {}
104002025-07-01T00:24:24.401ZDEBGnexus (BackgroundTasks): client request SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104012025-07-01T00:24:24.402ZDEBGnexus (BackgroundTasks): client response SledAgent = 887ec56b-486c-42d4-930b-b7b47cbacc61 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c661e2a5-910a-4aed-aac7-508f75d3be5e", "content-length": "691", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
104022025-07-01T00:24:24.402ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
104032025-07-01T00:24:24.402ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
104042025-07-01T00:24:24.402ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
104052025-07-01T00:24:24.403ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 500.108352ms iteration = 28 status = {}
104062025-07-01T00:24:24.418ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
104072025-07-01T00:24:24.419ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ee289973-2f4e-4bb5-b9c8-f4cfe9979af8", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104082025-07-01T00:24:24.419ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104092025-07-01T00:24:24.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e8235025-93f1-48d6-9cc4-476b6609e499", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104102025-07-01T00:24:24.421ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104112025-07-01T00:24:24.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e1d4fc09-71a0-4432-971c-12d0365c5816", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104122025-07-01T00:24:24.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104132025-07-01T00:24:24.426ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
104142025-07-01T00:24:24.426ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 523.606064ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
104152025-07-01T00:24:24.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104162025-07-01T00:24:24.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104172025-07-01T00:24:24.470ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: d2162e89-eb7d-4c93-ba10-e34abf14e6ae, rack_id: 93288d3a-a56c-4ba2-89cd-9c58115e5fe5, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(82f82bac-0f3a-432f-99b8-89e0bf51a99b) } rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
104182025-07-01T00:24:24.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104192025-07-01T00:24:24.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104202025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
104212025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 82f82bac-0f3a-432f-99b8-89e0bf51a99b
104222025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104232025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104242025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104252025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104262025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104272025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104282025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104292025-07-01T00:24:24.483ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104302025-07-01T00:24:24.484ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5
104312025-07-01T00:24:24.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104322025-07-01T00:24:24.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104332025-07-01T00:24:24.487ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch_location = Switch0
104342025-07-01T00:24:24.487ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104352025-07-01T00:24:24.601ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bf538e70-d108-4781-810f-2c567103f0ea", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
104362025-07-01T00:24:24.601ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 switch = Switch0
104372025-07-01T00:24:24.601ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104382025-07-01T00:24:24.601ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 93288d3a-a56c-4ba2-89cd-9c58115e5fe5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "639eae2a-2abd-4176-9da8-b9a54f607ac6", "content-length": "682", "date": "Tue, 01 Jul 2025 00:24:24 GMT"} })
104392025-07-01T00:24:24.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104402025-07-01T00:24:24.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104412025-07-01T00:24:24.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104422025-07-01T00:24:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104432025-07-01T00:24:24.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104442025-07-01T00:24:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104452025-07-01T00:24:24.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104462025-07-01T00:24:24.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104472025-07-01T00:24:24.618ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 714.896269ms iteration = 27 status = {}
104482025-07-01T00:24:24.923ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 549 local_addr = [fd00:1122:3344:101::a]:59035 method = GET remote_addr = [fd00:1122:3344:101::d]:36917 req_id = 64dfaf94-36b6-40ba-a1df-bde637f7677e response_code = 200 uri = /8da13144-b1e3-4f04-bf20-cd1fcf6b40c6
104492025-07-01T00:24:25.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d16a7ae6-3d2c-4e41-8a9f-a77bb5b8e752 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104502025-07-01T00:24:25.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d16a7ae6-3d2c-4e41-8a9f-a77bb5b8e752 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104512025-07-01T00:24:25.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = d16a7ae6-3d2c-4e41-8a9f-a77bb5b8e752 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104522025-07-01T00:24:26.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db3a3c8f-3ca6-463a-b894-4f66d4dc0da9 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104532025-07-01T00:24:26.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db3a3c8f-3ca6-463a-b894-4f66d4dc0da9 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104542025-07-01T00:24:26.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = db3a3c8f-3ca6-463a-b894-4f66d4dc0da9 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104552025-07-01T00:24:27.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c3f0764c-ef63-4142-8e04-7bcc69e534ea roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104562025-07-01T00:24:27.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c3f0764c-ef63-4142-8e04-7bcc69e534ea resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104572025-07-01T00:24:27.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = c3f0764c-ef63-4142-8e04-7bcc69e534ea response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104582025-07-01T00:24:28.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 68e2347d-014d-4671-94b7-8246f28ad359 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104592025-07-01T00:24:28.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 68e2347d-014d-4671-94b7-8246f28ad359 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104602025-07-01T00:24:28.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 68e2347d-014d-4671-94b7-8246f28ad359 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104612025-07-01T00:24:29.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 11e5bdf4-1255-4c2b-b91d-67890a6341a7 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104622025-07-01T00:24:29.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 11e5bdf4-1255-4c2b-b91d-67890a6341a7 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104632025-07-01T00:24:29.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2912 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 11e5bdf4-1255-4c2b-b91d-67890a6341a7 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104642025-07-01T00:24:30.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9492cea2-4a17-443b-a19f-2d3caafddac6 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104652025-07-01T00:24:30.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9492cea2-4a17-443b-a19f-2d3caafddac6 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104662025-07-01T00:24:30.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2861 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 9492cea2-4a17-443b-a19f-2d3caafddac6 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104672025-07-01T00:24:31.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b2b9d831-fb92-45e1-8af9-8a1260627b2c roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104682025-07-01T00:24:31.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b2b9d831-fb92-45e1-8af9-8a1260627b2c resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104692025-07-01T00:24:31.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = b2b9d831-fb92-45e1-8af9-8a1260627b2c response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104702025-07-01T00:24:32.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cadc5fe2-44fd-45b4-8608-c770814fb473 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104712025-07-01T00:24:32.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cadc5fe2-44fd-45b4-8608-c770814fb473 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104722025-07-01T00:24:32.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = cadc5fe2-44fd-45b4-8608-c770814fb473 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104732025-07-01T00:24:33.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7c5b9ff5-ad2d-4479-ab92-41f54c791115 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104742025-07-01T00:24:33.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7c5b9ff5-ad2d-4479-ab92-41f54c791115 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104752025-07-01T00:24:33.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 7c5b9ff5-ad2d-4479-ab92-41f54c791115 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104762025-07-01T00:24:33.904ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
104772025-07-01T00:24:33.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104782025-07-01T00:24:33.904ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
104792025-07-01T00:24:33.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104802025-07-01T00:24:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104812025-07-01T00:24:33.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104822025-07-01T00:24:33.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104832025-07-01T00:24:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104842025-07-01T00:24:33.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104852025-07-01T00:24:33.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104862025-07-01T00:24:33.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104872025-07-01T00:24:33.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104882025-07-01T00:24:33.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104892025-07-01T00:24:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c9f74bdf-f99d-492a-9cce-6960da102c33, lookup_type: ById(c9f74bdf-f99d-492a-9cce-6960da102c33) } result = Ok(())
104902025-07-01T00:24:33.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104912025-07-01T00:24:33.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104922025-07-01T00:24:33.931ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 original_time_created = 2025-07-01 00:11:15.051017 UTC target_id = c9f74bdf-f99d-492a-9cce-6960da102c33 time_created = 2025-07-01 00:11:15.051017 UTC
104932025-07-01T00:24:33.931ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.221005ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c9f74bdf-f99d-492a-9cce-6960da102c33","time_created":"2025-07-01T00:11:15.051017Z"}
104942025-07-01T00:24:33.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104952025-07-01T00:24:33.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104962025-07-01T00:24:33.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.66293ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104972025-07-01T00:24:34.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 856f1865-1750-4299-b843-6c3447c3afe3 roles = RoleSet { roles: {} } uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104982025-07-01T00:24:34.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 856f1865-1750-4299-b843-6c3447c3afe3 resource = Database result = Ok(()) uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61
104992025-07-01T00:24:34.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:37180 req_id = 856f1865-1750-4299-b843-6c3447c3afe3 response_code = 200 uri = /probes/887ec56b-486c-42d4-930b-b7b47cbacc61